Steerable Transformers
Paper • 2405.15932 • Published • 1
Papers - NEDL - Attention - Equivar - Steerable Transformers
Euclidean signal on Euclidean domains for keys, queries and values, with group action on codomain.
Note This configuration is also illustrated by the Steerable Transformer (Kundu and Kondor, 2024) which processes Euclidean codomains R^n with equivariance to the special Euclidean group SE(n), for application to image processing and machine learning tasks.