Attentive Group Equivariant Convolutional Networks
Not on the map. Why?
Abstract (arXiv)
Although group convolutional networks are able to learn powerful representations based on symmetry patterns, they lack explicit means to learn meaningful relationships among them (e.g., relative positions and poses). In this paper, we present attentive group equivariant convolutions, a generalization of the group convolution, in which attention is applied during the course of convolution to accentuate meaningful symmetry combinations and suppress non-plausible, misleading ones. We indicate that prior work on visual attention can be described as special cases of our proposed framework and show empirically that our attentive group equivariant convolutional networks consistently outperform conventional group convolutional networks on benchmark image datasets. Simultaneously, we provide interpretability to the learned concepts through the visualization of equivariant attention maps.
Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 9; 2023: 18; 2024: 9; 2025: 7; 2026: 3.
62 papers.
Sort:
By area:
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
- 2021Is Attention Better Than Matrix Decomposition?cited by 75
- 2021SE(3) Equivariant Graph Neural Networks with Complete Local Framescited by 75
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
- 2021Geometric Deep Learning and Equivariant Neural Networkscited by 64
- 2023Geometric Algebra Transformercited by 46
- 2021Learning Partial Equivariances from Datacited by 44
- 2022Unsupervised Learning of Group Invariant and Equivariant Representationscited by 38
- 2022Attention Mechanism in Neural Networks: Where it Comes and Where it Goescited by 29
- 2023E(2)-Equivariant Vision Transformercited by 27
- 2021Enabling equivariance for arbitrary Lie groupscited by 22
- 2022Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networkscited by 18
38 more
- 2021Equivariant Networks for Pixelized Spherescited by 16
- 2023Making Vision Transformers Truly Shift-Equivariantcited by 16
- 2023Truly Scale-Equivariant Deep Nets with Fourier Layerscited by 16
- 2021Group Equivariant Subsamplingcited by 15
- 2021Addressing the Topological Defects of Disentanglement via Distributed Operatorscited by 14
- 2023Alias-Free Convnets: Fractional Shift Invariance via Polynomial Activationscited by 11
- 2022Learning with Capsules: A Surveycited by 10
- 2023VTAE: Variational Transformer Autoencoder with Manifolds Learningcited by 10
- 2023Investigating how ReLU-networks encode symmetriescited by 8
- 2024Steerable Transformers for Volumetric Datacited by 8
- 2025Flopping for FLOPs: Leveraging equivariance for computational efficiencycited by 8
- 2022Improving the Sample-Complexity of Deep Classification Networks with Invariant Integrationcited by 7
- 2023FRED: Towards a Full Rotation-Equivariance in Aerial Image Object Detectioncited by 7
- 2024Symmetry-Based Structured Matrices for Efficient Approximately Equivariant Networkscited by 7
- 2025GradMetaNet: An Equivariant Architecture for Learning on Gradientscited by 7
- 2021Equivariant Wavelets: Fast Rotation and Translation Invariant Wavelet Scattering Transformscited by 6
- 2024SE(3) Equivariant Ray Embeddings for Implicit Multi-View Depth Estimationcited by 6
- 2025Diffusion Generative Modeling on Lie Group Representationscited by 6
- 2021Exploiting Learned Symmetries in Group Equivariant Convolutionscited by 5
- 2022A Graph and Attentive Multi-Path Convolutional Network for Traffic Predictioncited by 5
- 2023Steerable Equivariant Representation Learningcited by 5
- 2025Explicit Discovery of Nonlinear Symmetries from Dynamic Datacited by 5
- 2023Empowering Networks With Scale and Rotation Equivariance Using A Similarity Convolutioncited by 4
- 2023Using and Abusing Equivariancecited by 4
- 2023Self-Supervised Detection of Perfect and Partial Input-Dependent Symmetriescited by 4
- 2025Measuring the Impact of Rotation Equivariance on Aerial Object Detectioncited by 4
- 2021Autoequivariant Network Search via Group Decompositioncited by 3
- 2023Improving Equivariance in State-of-the-Art Supervised Depth and Normal Predictorscited by 3
- 2024ILPO-NET: Network for the invariant recognition of arbitrary volumetric patterns in 3Dcited by 3
- 2025Quick ViTs: Speeding up Vision Transformers through Equivariancecited by 3
- 20216DCNN with roto-translational convolution filters for volumetric data processingcited by 2
- 2023Deep Neural Networks with Efficient Guaranteed Invariancescited by 2
- 2024Building Hybrid B-Spline And Neural Network Operatorscited by 2
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learningcited by 2
- 2026RoVE: Rotary Value Embeddings Attention for Relative Position-dependent Value Pathwayscited by 2
- 2021Salient Positions based Attention Network for Image Classificationcited by 1
- 2022Towards the Human Global Context: Does the Vision-Language Model Really Judge Like a Human Being?cited by 1
- 2022Equivariant Light Field Convolution and Transformercited by 1
50 most cited of 62 All 62 (JSON)
- 2026REViT: Roto-reflection Equivariant Convolutional Vision Transformer24 Jun 2026
- 2026RoVE: Rotary Value Embeddings Attention for Relative Position-dependent Value Pathways9 Jun 2026
- 2026Learning Geometric Invariance for Gait Recognition9 Jan 2026
- 2025Explicit Discovery of Nonlinear Symmetries from Dynamic Data2 Oct 2025
- 2025Measuring the Impact of Rotation Equivariance on Aerial Object Detection14 Jul 2025
- 2025GradMetaNet: An Equivariant Architecture for Learning on Gradients2 Jul 2025
- 2025Quick ViTs: Speeding up Vision Transformers through Equivariance21 May 2025
- 2025RECON: Robust symmetry discovery via Explicit Canonical Orientation Normalization19 May 2025
- 2025Flopping for FLOPs: Leveraging equivariance for computational efficiency7 Feb 2025
- 2025Diffusion Generative Modeling on Lie Group Representations4 Feb 2025
- 2024SE(3) Equivariant Ray Embeddings for Implicit Multi-View Depth Estimation11 Nov 2024
- 2024PreCM: The Padding-based Rotation Equivariant Convolution Mode for Semantic Segmentation3 Nov 2024
38 more
- 2024Symmetry-Based Structured Matrices for Efficient Approximately Equivariant Networks18 Sep 2024
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learning11 Sep 2024
- 2024Building Hybrid B-Spline And Neural Network Operators6 Jun 2024
- 2024Steerable Transformers for Volumetric Data24 May 2024
- 2024On the Fourier analysis in the SO(3) space : EquiLoPO Network24 Apr 2024
- 2024ILPO-NET: Network for the invariant recognition of arbitrary volumetric patterns in 3D28 Mar 2024
- 2024Geometric Generative Models based on Morphological Equivariant PDEs and GANs22 Mar 2024
- 2023FRED: Towards a Full Rotation-Equivariance in Aerial Image Object Detection22 Dec 2023
- 2023Self-Supervised Detection of Perfect and Partial Input-Dependent Symmetries19 Dec 2023
- 2023Enhancing Solutions for Complex PDEs: Introducing Complementary Convolution and Equivariant Attention in Fourier Neural Operators21 Nov 2023
- 2023Truly Scale-Equivariant Deep Nets with Fourier Layers6 Nov 2023
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformers16 Oct 2023
- 2023Improving Equivariance in State-of-the-Art Supervised Depth and Normal Predictors28 Sep 2023
- 2023Using and Abusing Equivariance22 Aug 2023
- 2023Semantic Equivariant Mixup12 Aug 2023
- 2023E(2)-Equivariant Vision Transformer11 Jun 2023
- 2023Geometric Algebra Transformer28 May 2023
- 2023Investigating how ReLU-networks encode symmetries26 May 2023
- 2023Making Vision Transformers Truly Shift-Equivariant25 May 2023
- 2023Adaptive aggregation of Monte Carlo augmented decomposed filters for efficient group-equivariant convolutional neural network17 May 2023
- 2023VTAE: Variational Transformer Autoencoder with Manifolds Learning3 Apr 2023
- 2023Alias-Free Convnets: Fractional Shift Invariance via Polynomial Activations14 Mar 2023
- 2023Deep Neural Networks with Efficient Guaranteed Invariances2 Mar 2023
- 2023Empowering Networks With Scale and Rotation Equivariance Using A Similarity Convolution1 Mar 2023
- 2023Steerable Equivariant Representation Learning22 Feb 2023
- 2022Equivariant Light Field Convolution and Transformer30 Dec 2022
- 2022Robustcaps: a transformation-robust capsule network for image classification20 Oct 2022
- 2022Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networks14 Oct 2022
- 2022Towards the Human Global Context: Does the Vision-Language Model Really Judge Like a Human Being?18 Jul 2022
- 2022Learning with Capsules: A Survey6 Jun 2022
- 2022A Graph and Attentive Multi-Path Convolutional Network for Traffic Prediction30 May 2022
- 2022Attention Mechanism in Neural Networks: Where it Comes and Where it Goes27 Apr 2022
- 2022Unsupervised Learning of Group Invariant and Equivariant Representations15 Feb 2022
- 2022Improving the Sample-Complexity of Deep Classification Networks with Invariant Integration8 Feb 2022
- 2021Enabling equivariance for arbitrary Lie groups16 Nov 2021
- 2021SE(3) Equivariant Graph Neural Networks with Complete Local Frames26 Oct 2021
- 2021Learning Partial Equivariances from Data19 Oct 2021
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passing6 Oct 2021
50 newest of 62 All 62 (JSON)
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
- 2021Is Attention Better Than Matrix Decomposition?cited by 75
- 2021SE(3) Equivariant Graph Neural Networks with Complete Local Framescited by 75
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
- 2021Geometric Deep Learning and Equivariant Neural Networkscited by 64
- 2023Geometric Algebra Transformercited by 46
- 2021Learning Partial Equivariances from Datacited by 44
- 2022Unsupervised Learning of Group Invariant and Equivariant Representationscited by 38
- 2022Attention Mechanism in Neural Networks: Where it Comes and Where it Goescited by 29
- 2023E(2)-Equivariant Vision Transformercited by 27
- 2021Enabling equivariance for arbitrary Lie groupscited by 22
- 2022Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networkscited by 18
12 most cited of 60 All 60 (JSON)
- 2026REViT: Roto-reflection Equivariant Convolutional Vision Transformer24 Jun 2026
- 2026RoVE: Rotary Value Embeddings Attention for Relative Position-dependent Value Pathways9 Jun 2026
- 2026Learning Geometric Invariance for Gait Recognition9 Jan 2026
- 2025Explicit Discovery of Nonlinear Symmetries from Dynamic Data2 Oct 2025
- 2025Measuring the Impact of Rotation Equivariance on Aerial Object Detection14 Jul 2025
- 2025GradMetaNet: An Equivariant Architecture for Learning on Gradients2 Jul 2025
- 2025Quick ViTs: Speeding up Vision Transformers through Equivariance21 May 2025
- 2025RECON: Robust symmetry discovery via Explicit Canonical Orientation Normalization19 May 2025
- 2025Flopping for FLOPs: Leveraging equivariance for computational efficiency7 Feb 2025
- 2024SE(3) Equivariant Ray Embeddings for Implicit Multi-View Depth Estimation11 Nov 2024
- 2024PreCM: The Padding-based Rotation Equivariant Convolution Mode for Semantic Segmentation3 Nov 2024
- 2024Symmetry-Based Structured Matrices for Efficient Approximately Equivariant Networks18 Sep 2024
12 newest of 60 All 60 (JSON)