Spherical CNNs
Not on the map. Why?
Abstract (arXiv)
Convolutional Neural Networks (CNNs) have become the method of choice for learning problems involving 2D planar images. However, a number of problems of recent interest have created a demand for models that can analyze spherical images. Examples include omnidirectional vision for drones, robots, and autonomous cars, molecular regression problems, and global weather and climate modelling. A naive application of convolutional networks to a planar projection of the spherical signal is destined to fail, because the space-varying distortions introduced by such a projection will make translational weight sharing ineffective. In this paper we introduce the building blocks for constructing spherical CNNs. We propose a definition for the spherical cross-correlation that is both expressive and rotation-equivariant. The spherical correlation satisfies a generalized Fourier theorem, which allows us to compute it efficiently using a generalized (non-commutative) Fast Fourier Transform (FFT) algorithm. We demonstrate the computational efficiency, numerical accuracy, and effectiveness of spherical CNNs applied to 3D model recognition and atomization energy regression.
Key facts. Cited by 452 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 95; 2022: 104; 2023: 87; 2024: 60; 2025: 56; 2026: 50.
452 papers.
Sort:
By area:
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2021How to Train Your Energy-Based Modelscited by 271
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
- 2021A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groupscited by 185
- 2022From data to functa: Your data point is a function and you can treat it like onecited by 183
- 2022e3nn: Euclidean Neural Networkscited by 171
- 2021Frame Averaging for Invariant and Equivariant Network Designcited by 166
- 2021Hyperbolic Deep Neural Networks: A Surveycited by 138
38 more
- 2023Spherical Transformer for LiDAR-based 3D Recognitioncited by 124
- 2023Reducing SO(3) Convolutions to SO(2) for Efficient Equivariant GNNscited by 113
- 2023Equivariant Architectures for Learning in Deep Weight Spacescited by 106
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 94
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 91
- 2021Provably Strict Generalisation Benefit for Equivariant Modelscited by 90
- 2021Generative Models as Distributions of Functionscited by 89
- 2021Automatic Symmetry Discovery with Lie Algebra Convolutional Networkcited by 82
- 2021Equivariant Point Network for 3D Point Cloud Analysiscited by 81
- 2021SE(3) Equivariant Graph Neural Networks with Complete Local Framescited by 75
- 2022PAC-Bayes Compression Bounds So Tight That They Can Explain Generalizationcited by 75
- 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
- 2023Permutation Equivariant Neural Functionalscited by 69
- 2021You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant Descriptorscited by 68
- 2021SE(3)-equivariant prediction of molecular wavefunctions and electronic densitiescited by 67
- 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representationscited by 67
- 2021Geometric Deep Learning and Equivariant Neural Networkscited by 64
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
- 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
- 2022OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusioncited by 60
- 2022Learning Symmetric Embeddings for Equivariant World Modelscited by 54
- 2023Clifford Group Equivariant Neural Networkscited by 54
- 2023Towards Stability of Autoregressive Neural Operatorscited by 54
- 2022Transformation-Equivariant 3D Object Detection for Autonomous Drivingcited by 52
- 2023Equivariant Similarity for Vision-Language Foundation Modelscited by 51
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learningcited by 49
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detectioncited by 48
- 2021Self-Supervised Learning Disentangled Group Representation as Featurecited by 47
- 2022Spherical Channels for Modeling Atomic Interactionscited by 47
- 2021Learning Partial Equivariances from Datacited by 44
- 2021LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Renderingcited by 42
- 2022Invariance Learning in Deep Neural Networks with Differentiable Laplace Approximationscited by 42
- 2023EGformer: Equirectangular Geometry-biased Transformer for 360 Depth Estimationcited by 42
- 2023Group Equivariant Fourier Neural Operators for Partial Differential Equationscited by 42
- 2022Relaxing Equivariance Constraints with Non-stationary Continuous Filterscited by 41
- 2023Self-supervised learning of Split Invariant Equivariant representationscited by 41
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
50 most cited of 452 All 452 (JSON)
- 2026A library for differentiable signal processing and machine learning on the sphere30 Sep 2026
- 2026Decoupling Spherical Reasoning from Dense Prediction for 360 Depth Estimation30 Sep 2026
- 2026SCCM: Spherically Consistent Coarse Matching for ERP Dense Feature Correspondence29 Sep 2026
- 2026Informative Viewpoint Selection for Episodic-Memory Embodied Question Answering using Omnidirectional Images27 Sep 2026
- 2026QSV: Quat-Sphere-Vision for Coupled Quaternion Attention on Spherical Lattices24 Sep 2026
- 2026Gauge-Equivariant Attention for Rotation-Stable 360^circ Scene Understanding23 Sep 2026
- 2026Geometric-to-Semantic Spherical Transfer Learning for Cortical Sulci Labeling11 Sep 2026
- 2026AdapToPASS: Ambiguity-aware Adaptive Spherical Transformer for Panoramic Semantic Segmentation29 Aug 2026
- 2026Boosting Data Augmentation with Stochastic Weight Averaging14 Aug 2026
- 2026Riemann GeoResolver: A Non-Euclidean Attention Framework from Euclidean Resolver to Hyperbolic-Spherical Geometry11 Aug 2026
- 2026Optimal Neural Network Approximation via Empirical Least Squares with Deterministic Samples7 Aug 2026
- 2026Protocol generalisation for brain tissue microstructure estimation via hypernetwork-controlled geometric deep learning3 Aug 2026
38 more
- 2026Generator-Aligned Representation Interfaces for Diagnostic Soft Equivariance28 Jul 2026
- 2026Adaptive Interpolatory Curve Subdivision with Learned Local Angles25 Jul 2026
- 2026Physical Self-Supervised Learning: IMU Sensing without Manual Labels20 Jul 2026
- 2026E3DGS: Unified Geometric-Photometric Equivariance for 3D Gaussian Splatting via Color-as-Geometry Embedding17 Jul 2026
- 2026SVI360: Spherical Video Interpolation13 Jul 2026
- 2026Group Invariant Spectral Embedding9 Jul 2026
- 2026Agentic Neural Architecture Search8 Jul 2026
- 2026EAGLE-360: Embodied Active Global-to-Local Exploration in 360^circ2 Jul 2026
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modeling26 Jun 2026
- 2026REViT: Roto-reflection Equivariant Convolutional Vision Transformer24 Jun 2026
- 2026What Your Model Threw Away and Why You'll Want It Back: Masking, Fingerprinting, and Privacy from Discarded Geometry17 Jun 2026
- 2026Factorized Neural Operators Decompose Dynamic and Persistent Responses15 Jun 2026
- 2026On the Equivariant Learning of the Q-tensor Order Parameter26 May 2026
- 2026Rotation-Invariant Spherical Watermarking via Third-Order SO(3) Representation Coupling26 May 2026
- 2026NeurIPS: Neuro-anatomical Inductive Priors for Sphere-based Brain Decoding24 May 2026
- 2026Scale-Equivariant Generative Forecasting: Weight-Tied Dilated Convolutions, Wavelet Scattering Inputs, and Spectral-Consistency Training for Self-Similar Time Series17 May 2026
- 2026Diagnosing Spectral Ceilings in Equivariant Neural Force Fields8 May 2026
- 2026bispectrum: Selective G-Bispectra Made Practical8 May 2026
- 2026Star-Fusion: A Multi-modal Transformer Architecture for Discrete Celestial Orientation via Spherical Topology29 Apr 2026
- 2026Sphere-Depth: A Benchmark for Depth Estimation Methods with Varying Spherical Camera Orientations25 Apr 2026
- 2026EquiformerV3: Scaling Efficient, Expressive, and General SE(3)-Equivariant Graph Attention Transformers10 Apr 2026
- 2026Bridging the Dimensionality Gap: A Taxonomy and Survey of 2D Vision Model Adaptation for 3D Analysis3 Apr 2026
- 2026A Neural Tension Operator for Curve Subdivision across Constant Curvature Geometries30 Mar 2026
- 2026PanoVGGT: Feed-Forward 3D Reconstruction from Panoramic Imagery18 Mar 2026
- 2026FoV-Net: Rotation-Invariant CAD B-rep Learning via Field-of-View Ray Casting27 Feb 2026
- 2026SO3UFormer: Learning Intrinsic Spherical Features for Rotation-Robust Panoramic Dense Prediction26 Feb 2026
- 2026A Graph Meta-Network for Learning on Kolmogorov-Arnold Networks18 Feb 2026
- 2026The geometry of invariant learning: an information-theoretic analysis of data augmentation and generalization16 Feb 2026
- 2026DEGMC: Denoising Diffusion Models Based on Riemannian Equivariant Group Morphological Convolutions10 Feb 2026
- 2026Radial M"untz-Sz'asz Networks: Neural Architectures with Learnable Power Bases for Multidimensional Singularities9 Feb 2026
- 2026Breaking Symmetry Bottlenecks in GNN Readouts5 Feb 2026
- 2026SurfAge-Net: A Hierarchical Surface-Based Network for Interpretable Fine-Grained Brain Age Prediction28 Jan 2026
- 2026Neural Operators for Biomedical Spherical Heterogeneity7 Jan 2026
- 2026360DVO: Deep Visual Odometry for Monocular 360-Degree Camera5 Jan 2026
- 2026Quantized SO(3)-Equivariant Graph Neural Networks for Efficient Molecular Property Prediction5 Jan 2026
- 2026Edge-aware GAT-based protein binding site prediction5 Jan 2026
- 2026Neural Networks on Symmetric Spaces of Noncompact Type3 Jan 2026
- 2026An AI Monkey Gets Grapes for Sure -- Sphere Neural Networks for Reliable Decision-Making1 Jan 2026
50 newest of 452 All 452 (JSON)
- 2023EDGI: Equivariant Diffusion for Planning with Embodied Agentscited by 35
- 2023Diffusion Probabilistic Fieldscited by 28
- 2023Diffusion probabilistic models enhance variational autoencoder for crystal structure generative modelingcited by 17
- 2025SE(3)-Equivariant Diffusion Policy in Spherical Fourier Spacecited by 7
- 2023RePoseDM: Recurrent Pose Alignment and Gradient Guidance for Pose Guided Image Synthesiscited by 2
- 2026DEGMC: Denoising Diffusion Models Based on Riemannian Equivariant Group Morphological Convolutionscited by 0
- 2026DEGMC: Denoising Diffusion Models Based on Riemannian Equivariant Group Morphological Convolutions10 Feb 2026
- 2025SE(3)-Equivariant Diffusion Policy in Spherical Fourier Space2 Jul 2025
- 2023RePoseDM: Recurrent Pose Alignment and Gradient Guidance for Pose Guided Image Synthesis24 Oct 2023
- 2023Diffusion probabilistic models enhance variational autoencoder for crystal structure generative modeling4 Aug 2023
- 2023EDGI: Equivariant Diffusion for Planning with Embodied Agents22 Mar 2023
- 2023Diffusion Probabilistic Fields1 Mar 2023
- 2025TusoAI: Agentic Optimization for Scientific Methodscited by 2
- 2026Agentic Neural Architecture Searchcited by 1
- 2026Agentic Neural Architecture Search8 Jul 2026
- 2025TusoAI: Agentic Optimization for Scientific Methods28 Sep 2025
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 91
- 2022Learning Symmetric Embeddings for Equivariant World Modelscited by 54
- 2022Learning to Generate Realistic LiDAR Point Clouds8 Sep 2022
- 2022Learning Symmetric Embeddings for Equivariant World Models24 Apr 2022
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2021How to Train Your Energy-Based Modelscited by 271
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 201
- 2021A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groupscited by 185
- 2022From data to functa: Your data point is a function and you can treat it like onecited by 183
- 2022e3nn: Euclidean Neural Networkscited by 171
- 2021Frame Averaging for Invariant and Equivariant Network Designcited by 166
- 2021Hyperbolic Deep Neural Networks: A Surveycited by 138
12 most cited of 435 All 435 (JSON)
- 2026A library for differentiable signal processing and machine learning on the sphere30 Sep 2026
- 2026Decoupling Spherical Reasoning from Dense Prediction for 360 Depth Estimation30 Sep 2026
- 2026SCCM: Spherically Consistent Coarse Matching for ERP Dense Feature Correspondence29 Sep 2026
- 2026Informative Viewpoint Selection for Episodic-Memory Embodied Question Answering using Omnidirectional Images27 Sep 2026
- 2026QSV: Quat-Sphere-Vision for Coupled Quaternion Attention on Spherical Lattices24 Sep 2026
- 2026Gauge-Equivariant Attention for Rotation-Stable 360^circ Scene Understanding23 Sep 2026
- 2026Geometric-to-Semantic Spherical Transfer Learning for Cortical Sulci Labeling11 Sep 2026
- 2026AdapToPASS: Ambiguity-aware Adaptive Spherical Transformer for Panoramic Semantic Segmentation29 Aug 2026
- 2026Boosting Data Augmentation with Stochastic Weight Averaging14 Aug 2026
- 2026Riemann GeoResolver: A Non-Euclidean Attention Framework from Euclidean Resolver to Hyperbolic-Spherical Geometry11 Aug 2026
- 2026Optimal Neural Network Approximation via Empirical Least Squares with Deterministic Samples7 Aug 2026
- 2026Protocol generalisation for brain tissue microstructure estimation via hypernetwork-controlled geometric deep learning3 Aug 2026
12 newest of 435 All 435 (JSON)