Exploiting Cyclic Symmetry in Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
Many classes of images exhibit rotational symmetry. Convolutional neural networks are sometimes trained using data augmentation to exploit this, but they are still required to learn the rotation equivariance properties from the data. Encoding these properties into the network architecture, as we are already used to doing for translation equivariance by using convolutional layers, could result in a more efficient use of the parameter budget by relieving the model from learning them. We introduce four operations which can be inserted into neural network models as layers, and which can be combined to make these models partially equivariant to rotations. They also enable parameter sharing across different orientations. We evaluate the effect of these architectural modifications on three datasets which exhibit rotational symmetry and demonstrate improved performance with smaller models.
Key facts. Cited by 91 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Feb 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 31; 2022: 21; 2023: 17; 2024: 9; 2025: 9; 2026: 4.
91 papers.
Sort:
- 2021NeRV: Neural Representations for Videoscited by 255
- 2021E(n) Equivariant Normalizing Flowscited by 165
- 2022Approximately Equivariant Networks for Imperfectly Symmetric Dynamicscited by 95
- 2021SE(3) Equivariant Graph Neural Networks with Complete Local Framescited by 75
- 2023Pushing the Limits of Fewshot Anomaly Detection in Industry Vision: Graphcorecited by 75
- 2021Geometric Deep Learning and Equivariant Neural Networkscited by 64
- 2021Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot Learningcited by 56
- 2021Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud Learningcited by 52
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detectioncited by 48
- 2021Learning Partial Equivariances from Datacited by 44
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
- 2022Unsupervised Learning of Group Invariant and Equivariant Representationscited by 38
38 more
- 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generationcited by 31
- 2021Equivariant neural networks for inverse problemscited by 29
- 2021Commutative Lie Group VAE for Disentanglement Learningcited by 27
- 2022Symmetry Group Equivariant Architectures for Physicscited by 23
- 2024Lie Algebra Canonicalization: Equivariant Neural Operators under arbitrary Lie Groupscited by 23
- 2022A Theory of PAC Learnability under Transformation Invariancescited by 21
- 2022Maximum Class Separation as Inductive Bias in One Matrixcited by 21
- 2022RIC-CNN: Rotation-Invariant Coordinate Convolutional Neural Networkcited by 20
- 2023Discovering Symmetry Breaking in Physical Systems with Relaxed Group Convolutioncited by 19
- 2021Scale-invariant scale-channel networks: Deep networks that generalise to previously unseen scalescited by 17
- 2022A PAC-Bayesian Generalization Bound for Equivariant Networkscited by 17
- 2023Revisiting Data Augmentation for Rotational Invariance in Convolutional Neural Networkscited by 16
- 2021Group Equivariant Subsamplingcited by 15
- 2023What Affects Learned Equivariance in Deep Image Recognition Models?cited by 14
- 2021Relative stability toward diffeomorphisms indicates performance in deep netscited by 12
- 2021Symmetry reduction for deep reinforcement learning active control of chaotic spatiotemporal dynamicscited by 10
- 2021Learning Equivariant Energy Based Models with Equivariant Stein Variational Gradient Descentcited by 10
- 2022Learning with Capsules: A Surveycited by 10
- 2023Rotation Invariant Transformer for Recognizing Object in UAVscited by 10
- 2022Robust Perception through Equivariancecited by 9
- 2024A Characterization Theorem for Equivariant Networks with Point-wise Activationscited by 9
- 2022Analysis of (sub-)Riemannian PDE-G-CNNscited by 8
- 2025Flopping for FLOPs: Leveraging equivariance for computational efficiencycited by 8
- 2021Mesh-based graph convolutional neural networks for modeling materials with microstructurecited by 7
- 2021Universal approximation and model compression for radial neural networkscited by 7
- 2024How Deep Networks Learn Sparse and Hierarchical Data: the Sparse Random Hierarchy Modelcited by 7
- 2023PixelRNN: In-pixel Recurrent Neural Networks for End-to-end-optimized Perception with Neural Sensorscited by 6
- 2023E(2) Equivariant Neural Networks for Robust Galaxy Morphology Classificationcited by 6
- 2021Improving Sound Event Classification by Increasing Shift Invariance in Convolutional Neural Networkscited by 5
- 2023Steerable Equivariant Representation Learningcited by 5
- 2021Adjoint Rigid Transform Network: Task-conditioned Alignment of 3D Shapescited by 4
- 2022Analysis of convolutional neural network image classifiers in a rotationally symmetric modelcited by 4
- 2022Quiver neural networkscited by 4
- 2022Beyond CNNs: Exploiting Further Inherent Symmetries in Medical Image Segmentationcited by 4
- 2025Spectral State Space Model for Rotation-Invariant Visual Representation Learningcited by 4
- 2021Self-Supervised Multi-View Learning via Auto-Encoding 3D Transformationscited by 3
- 2021Self-Supervised Graph Representation Learning via Topology Transformationscited by 3
- 2021Designing Rotationally Invariant Neural Networks from PDEs and Variational Methodscited by 3
50 most cited of 91 All 91 (JSON)
- 2026Transversal Pooling Neural Networks28 Sep 2026
- 2026On the Equivariant Learning of the Q-tensor Order Parameter26 May 2026
- 2026S2P-Net: A Spectral-Spatial Polar Network for Rotation-Invariant Object Recognition in Low-Data Regimes10 May 2026
- 2026Vanilla Group Equivariant Vision Transformer: Simple and Effective8 Feb 2026
- 2025Accelerated Rotation-Invariant Convolution for UAV Image Segmentation9 Dec 2025
- 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation11 Sep 2025
- 2025Hierarchical Adaptive networks with Task vectors for Test-Time Adaptation11 Aug 2025
- 2025Quick ViTs: Speeding up Vision Transformers through Equivariance21 May 2025
- 2025GMR-Conv: An Efficient Rotation and Reflection Equivariant Convolution Kernel Using Gaussian Mixture Rings3 Apr 2025
- 2025NdLinear: Preserving Multi-Dimensional Structure for Parameter-Efficient Neural Networks21 Mar 2025
- 2025Spectral State Space Model for Rotation-Invariant Visual Representation Learning9 Mar 2025
- 2025Flopping for FLOPs: Leveraging equivariance for computational efficiency7 Feb 2025
38 more
- 2025Improved Vessel Segmentation with Symmetric Rotation-Equivariant U-Net24 Jan 2025
- 2024Group Crosscoders for Mechanistic Analysis of Symmetry31 Oct 2024
- 2024MARs: Multi-view Attention Regularizations for Patch-based Feature Recognition of Space Terrain7 Oct 2024
- 2024Lie Algebra Canonicalization: Equivariant Neural Operators under arbitrary Lie Groups3 Oct 2024
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learning11 Sep 2024
- 2024Multi-view Action Recognition via Directed Gromov-Wasserstein Discrepancy2 May 2024
- 2024How Deep Networks Learn Sparse and Hierarchical Data: the Sparse Random Hierarchy Model16 Apr 2024
- 2024Equivariant graph convolutional neural networks for the representation of homogenized anisotropic microstructural mechanical response5 Apr 2024
- 2024A Characterization Theorem for Equivariant Networks with Point-wise Activations17 Jan 2024
- 2024Towards Harmonization of SO(3)-Equivariance and Expressiveness: a Hybrid Deep Learning Framework for Electronic-Structure Hamiltonian Prediction1 Jan 2024
- 2023Affine Invariance in Continuous-Domain Convolutional Neural Networks13 Nov 2023
- 2023Rotation Invariant Transformer for Recognizing Object in UAVs5 Nov 2023
- 2023E(2) Equivariant Neural Networks for Robust Galaxy Morphology Classification2 Nov 2023
- 2023H-NeXt: The next step towards roto-translation invariant networks2 Nov 2023
- 2023Invariance Measures for Neural Networks26 Oct 2023
- 2023Revisiting Data Augmentation for Rotational Invariance in Convolutional Neural Networks12 Oct 2023
- 2023Discovering Symmetry Breaking in Physical Systems with Relaxed Group Convolution3 Oct 2023
- 2023Modularity in Deep Learning: A Survey2 Oct 2023
- 2023Learning to Transform for Generalizable Instance-wise Invariance28 Sep 2023
- 2023Learning Linear Groups in Neural Networks29 May 2023
- 2023Group Equivariant BEV for 3D Object Detection26 Apr 2023
- 2023PixelRNN: In-pixel Recurrent Neural Networks for End-to-end-optimized Perception with Neural Sensors11 Apr 2023
- 2023What Affects Learned Equivariance in Deep Image Recognition Models?5 Apr 2023
- 2023Steerable Equivariant Representation Learning22 Feb 2023
- 2023Pushing the Limits of Fewshot Anomaly Detection in Industry Vision: Graphcore28 Jan 2023
- 2023Equivariant and Steerable Neural Networks: A review with special emphasis on the symmetric group8 Jan 2023
- 2023Transferable Energy Storage Bidder2 Jan 2023
- 2022Robust Perception through Equivariance12 Dec 2022
- 2022RIC-CNN: Rotation-Invariant Coordinate Convolutional Neural Network21 Nov 2022
- 2022Learning unfolded networks with a cyclic group structure16 Nov 2022
- 2022A PAC-Bayesian Generalization Bound for Equivariant Networks24 Oct 2022
- 2022Symmetry Defense Against CNN Adversarial Perturbation Attacks8 Oct 2022
- 2022Analysis of (sub-)Riemannian PDE-G-CNNs3 Oct 2022
- 2022Efficient Unsupervised Learning for Plankton Images14 Sep 2022
- 2022Beyond CNNs: Exploiting Further Inherent Symmetries in Medical Image Segmentation29 Jul 2022
- 2022Quiver neural networks26 Jul 2022
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detection21 Jul 2022
- 2022Maximum Class Separation as Inductive Bias in One Matrix17 Jun 2022
50 newest of 91 All 91 (JSON)
- 2021NeRV: Neural Representations for Videoscited by 255
- 2021E(n) Equivariant Normalizing Flowscited by 165
- 2022Approximately Equivariant Networks for Imperfectly Symmetric Dynamicscited by 95
- 2021SE(3) Equivariant Graph Neural Networks with Complete Local Framescited by 75
- 2023Pushing the Limits of Fewshot Anomaly Detection in Industry Vision: Graphcorecited by 75
- 2021Geometric Deep Learning and Equivariant Neural Networkscited by 64
- 2021Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot Learningcited by 56
- 2021Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud Learningcited by 52
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detectioncited by 48
- 2021Learning Partial Equivariances from Datacited by 44
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
- 2022Unsupervised Learning of Group Invariant and Equivariant Representationscited by 38
12 most cited of 91 All 91 (JSON)
- 2026Transversal Pooling Neural Networks28 Sep 2026
- 2026On the Equivariant Learning of the Q-tensor Order Parameter26 May 2026
- 2026S2P-Net: A Spectral-Spatial Polar Network for Rotation-Invariant Object Recognition in Low-Data Regimes10 May 2026
- 2026Vanilla Group Equivariant Vision Transformer: Simple and Effective8 Feb 2026
- 2025Accelerated Rotation-Invariant Convolution for UAV Image Segmentation9 Dec 2025
- 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation11 Sep 2025
- 2025Hierarchical Adaptive networks with Task vectors for Test-Time Adaptation11 Aug 2025
- 2025Quick ViTs: Speeding up Vision Transformers through Equivariance21 May 2025
- 2025GMR-Conv: An Efficient Rotation and Reflection Equivariant Convolution Kernel Using Gaussian Mixture Rings3 Apr 2025
- 2025NdLinear: Preserving Multi-Dimensional Structure for Parameter-Efficient Neural Networks21 Mar 2025
- 2025Spectral State Space Model for Rotation-Invariant Visual Representation Learning9 Mar 2025
- 2025Flopping for FLOPs: Leveraging equivariance for computational efficiency7 Feb 2025
12 newest of 91 All 91 (JSON)