Learning SO(3) Equivariant Representations with Spherical CNNs
Not on the map. Why?
Abstract (arXiv)
We address the problem of 3D rotation equivariance in convolutional neural networks. 3D rotations have been a challenging nuisance in 3D classification tasks requiring higher capacity and extended data augmentation in order to tackle it. We model 3D data with multi-valued spherical functions and we propose a novel spherical convolutional network that implements exact convolutions on the sphere by realizing them in the spherical harmonic domain. Resulting filters have local symmetry and are localized by enforcing smooth spectra. We apply a novel pooling on the spectral domain and our operations are independent of the underlying spherical resolution throughout the network. We show that networks with much lower capacity and without requiring data augmentation can exhibit performance comparable to the state of the art in standard retrieval and classification benchmarks.
Key facts. Cited by 244 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 61; 2022: 57; 2023: 48; 2024: 28; 2025: 26; 2026: 24.
244 papers.
Sort:
By area:
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021Frame Averaging for Invariant and Equivariant Network Designcited by 166
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021Hyperbolic Deep Neural Networks: A Surveycited by 138
- 2022Equivariance with Learned Canonicalization Functionscited by 106
- 2023Equivariant Architectures for Learning in Deep Weight Spacescited by 106
- 2021Model-Based Domain Generalizationcited by 103
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 20213D AffordanceNet: A Benchmark for Visual Object Affordance Understandingcited by 100
38 more
- 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 94
- 2021Generative Models as Distributions of Functionscited by 89
- 2021Equivariant Point Network for 3D Point Cloud Analysiscited by 81
- 2021You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant Descriptorscited by 68
- 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representationscited by 67
- 2021Geometric Deep Learning and Equivariant Neural Networkscited by 64
- 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
- 2023Towards Stability of Autoregressive Neural Operatorscited by 54
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learningcited by 49
- 2022Spherical Channels for Modeling Atomic Interactionscited by 47
- 2021LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Renderingcited by 42
- 2023VI-Net: Boosting Category-level 6D Object Pose Estimation via Learning Decoupled Rotations on the Spherical Representationscited by 40
- 2023Equivariant Adaptation of Large Pretrained Modelscited by 40
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2021DISCO: accurate Discrete Scale Convolutionscited by 35
- 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimationcited by 35
- 2022Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learningcited by 32
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2021Geometry-Aware Self-Training for Unsupervised Domain Adaptationon Object Point Cloudscited by 31
- 2022ConDor: Self-Supervised Canonicalization of 3D Pose for Partial Shapescited by 31
- 2021Conditional Local Convolution for Spatio-temporal Meteorological Forecastingcited by 30
- 2022RIConv++: Effective Rotation Invariant Convolutions for 3D Point Clouds Deep Learningcited by 29
- 2022PointConvFormer: Revenge of the Point-based Convolutioncited by 29
- 2023E(2)-Equivariant Vision Transformercited by 27
- 2022SE(3)-Equivariant Attention Networks for Shape Reconstruction in Function Spacecited by 26
- 2021Correspondence-Free Point Cloud Registration with SO(3)-Equivariant Implicit Shape Representationscited by 24
- 2023Deep Learning-based 3D Point Cloud Classification: A Systematic Survey and Outlookcited by 24
- 2022Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutionscited by 23
- 2021Exploiting Redundancy: Separable Group Convolutional Networks on Lie Groupscited by 22
- 2024Improving Equivariant Model Training via Constraint Relaxationcited by 22
- 2021Homogeneous vector bundles and G-equivariant convolutional neural networkscited by 21
- 2022Rotationally Equivariant 3D Object Detectioncited by 21
- 2022Towards General-Purpose Representation Learning of Polygonal Geometriescited by 21
- 2023Scaling Spherical CNNscited by 21
- 2021Rotation-Equivariant Deep Learning for Diffusion MRIcited by 20
- 2022Unified Fourier-based Kernel and Nonlinearity Design for Equivariant Networks on Homogeneous Spacescited by 20
- 2021PDO-eS2CNNs: Partial Differential Operator Based Equivariant Spherical CNNscited by 19
- 2022Flattening-Net: Deep Regular 2D Representation for 3D Point Cloud Analysiscited by 19
50 most cited of 244 All 244 (JSON)
- 2026A library for differentiable signal processing and machine learning on the sphere30 Sep 2026
- 2026Decoupling Spherical Reasoning from Dense Prediction for 360 Depth Estimation30 Sep 2026
- 2026SphMind: Towards Robust, Training-Free VLM-based Spatial Reasoning with a 360 Camera27 Sep 2026
- 2026Gauge-Equivariant Attention for Rotation-Stable 360^circ Scene Understanding23 Sep 2026
- 2026Heat Field Signatures: From Point Clouds to Smooth Geometry7 Sep 2026
- 2026AdapToPASS: Ambiguity-aware Adaptive Spherical Transformer for Panoramic Semantic Segmentation29 Aug 2026
- 2026ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopy22 Aug 2026
- 2026Rotation-Invariant Multi-IMU Activity Recognition under Independent Per-Location Orientation Shifts16 Aug 2026
- 2026Riemann GeoResolver: A Non-Euclidean Attention Framework from Euclidean Resolver to Hyperbolic-Spherical Geometry11 Aug 2026
- 2026Protocol generalisation for brain tissue microstructure estimation via hypernetwork-controlled geometric deep learning3 Aug 2026
- 2026EAGOR: Embodied Reasoning in Omni-direction7 Jul 2026
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modeling26 Jun 2026
38 more
- 2026REViT: Roto-reflection Equivariant Convolutional Vision Transformer24 Jun 2026
- 2026Benchmark Dataset for Catalysis on 2D MXenes30 May 2026
- 2026Rotation-Invariant Spherical Watermarking via Third-Order SO(3) Representation Coupling26 May 2026
- 2026bispectrum: Selective G-Bispectra Made Practical8 May 2026
- 2026Diff-SBSR: Learning Multimodal Feature-Enhanced Diffusion Models for Zero-Shot Sketch-Based 3D Shape Retrieval21 Apr 2026
- 2026Multi-View Hierarchical Graph Neural Network for Sketch-Based 3D Shape Retrieval20 Apr 2026
- 2026FoV-Net: Rotation-Invariant CAD B-rep Learning via Field-of-View Ray Casting27 Feb 2026
- 2026Spectral Convolution on Orbifolds for Geometric Deep Learning16 Feb 2026
- 2026RI-Mamba: Rotation-Invariant Mamba for Robust Text-to-Shape Retrieval12 Feb 2026
- 2026HyQuRP: Hybrid quantum-classical neural network with rotational and permutational equivariance6 Feb 2026
- 2026Recurrent Equivariant Constraint Modulation: Learning Per-Layer Symmetry Relaxation from Data2 Feb 2026
- 2026REVNET: Rotation-Equivariant Point Cloud Completion via Vector Neuron Anchor Transformer13 Jan 2026
- 2025CHyLL: Learning Continuous Neural Representations of Hybrid Systems10 Dec 2025
- 2025RecruitView: A Multimodal Dataset for Predicting Personality and Interview Performance for Human Resources Applications29 Nov 2025
- 2025NeuroVascU-Net: A Unified Multi-Scale and Cross-Domain Adaptive Feature Fusion U-Net for Precise 3D Segmentation of Brain Vessels in Contrast-Enhanced T1 MRI23 Nov 2025
- 2025Unified Spherical Frontend: Learning Rotation-Equivariant Representations of Spherical Images from Any Camera22 Nov 2025
- 2025Learning with Category-Equivariant Architectures for Human Activity Recognition3 Nov 2025
- 2025Explicit Discovery of Nonlinear Symmetries from Dynamic Data2 Oct 2025
- 2025Learning Generalizable Shape Completion with SIM(3) Equivariance30 Sep 2025
- 2025Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networks29 Sep 2025
- 2025FS-KAN: Permutation Equivariant Kolmogorov-Arnold Networks via Function Sharing29 Sep 2025
- 2025Large Vision Models Can Solve Mental Rotation Problems18 Sep 2025
- 2025GradMetaNet: An Equivariant Architecture for Learning on Gradients2 Jul 2025
- 2025Geometric and Physical Constraints Synergistically Enhance Neural PDE Surrogates5 Jun 2025
- 2025Surrogate Modeling of 3D Rayleigh-Benard Convection with Equivariant Autoencoders19 May 2025
- 2025Attention on the Sphere16 May 2025
- 2025A Survey of Robotic Navigation and Manipulation with Physics Simulators in the Era of Embodied AI1 May 2025
- 2025Position: Beyond Euclidean -- Foundation Models Should Embrace Non-Euclidean Geometries11 Apr 2025
- 2025Equivariant Spherical CNNs for Accurate Fiber Orientation Distribution Estimation in Neonatal Diffusion MRI with Reduced Acquisition Time2 Apr 2025
- 2025Permutation Equivariant Neural Networks for Symmetric Tensors14 Mar 2025
- 2025SO(3)-Equivariant Neural Networks for Learning from Scalar and Vector Fields on Spheres12 Mar 2025
- 2025GAGrasp: Geometric Algebra Diffusion for Dexterous Grasping6 Mar 2025
- 2025EDM: Equirectangular Projection-Oriented Dense Kernelized Feature Matching28 Feb 2025
- 2025EquiTabPFN: A Target-Permutation Equivariant Prior Fitted Networks10 Feb 2025
- 2025Fast Omni-Directional Image Super-Resolution: Adapting the Implicit Image Function with Pixel and Semantic-Wise Spherical Geometric Priors9 Feb 2025
- 2025SIDDA: SInkhorn Dynamic Domain Adaptation for Image Classification with Equivariant Neural Networks23 Jan 2025
- 2025Symmetry-Aware Generative Modeling through Learned Canonicalization14 Jan 2025
- 2025Few-shot Implicit Function Generation via Equivariance3 Jan 2025
50 newest of 244 All 244 (JSON)
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021Frame Averaging for Invariant and Equivariant Network Designcited by 166
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021Hyperbolic Deep Neural Networks: A Surveycited by 138
- 2022Equivariance with Learned Canonicalization Functionscited by 106
- 2023Equivariant Architectures for Learning in Deep Weight Spacescited by 106
- 2021Model-Based Domain Generalizationcited by 103
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 20213D AffordanceNet: A Benchmark for Visual Object Affordance Understandingcited by 100
12 most cited of 238 All 238 (JSON)
- 2026A library for differentiable signal processing and machine learning on the sphere30 Sep 2026
- 2026Decoupling Spherical Reasoning from Dense Prediction for 360 Depth Estimation30 Sep 2026
- 2026Gauge-Equivariant Attention for Rotation-Stable 360^circ Scene Understanding23 Sep 2026
- 2026Heat Field Signatures: From Point Clouds to Smooth Geometry7 Sep 2026
- 2026AdapToPASS: Ambiguity-aware Adaptive Spherical Transformer for Panoramic Semantic Segmentation29 Aug 2026
- 2026ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopy22 Aug 2026
- 2026Rotation-Invariant Multi-IMU Activity Recognition under Independent Per-Location Orientation Shifts16 Aug 2026
- 2026Riemann GeoResolver: A Non-Euclidean Attention Framework from Euclidean Resolver to Hyperbolic-Spherical Geometry11 Aug 2026
- 2026Protocol generalisation for brain tissue microstructure estimation via hypernetwork-controlled geometric deep learning3 Aug 2026
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modeling26 Jun 2026
- 2026REViT: Roto-reflection Equivariant Convolutional Vision Transformer24 Jun 2026
- 2026Benchmark Dataset for Catalysis on 2D MXenes30 May 2026
12 newest of 238 All 238 (JSON)