Equivariant Networks for Pixelized Spheres
Not on the map. Why?
Abstract (arXiv)
Pixelizations of Platonic solids such as the cube and icosahedron have been widely used to represent spherical data, from climate records to Cosmic Microwave Background maps. Platonic solids have well-known global symmetries. Once we pixelize each face of the solid, each face also possesses its own local symmetries in the form of Euclidean isometries. One way to combine these symmetries is through a hierarchy. However, this approach does not adequately model the interplay between the two levels of symmetry transformations. We show how to model this interplay using ideas from group theory, identify the equivariant linear maps, and introduce equivariant padding that respects these symmetries. Deep networks that use these maps as their building blocks generalize gauge equivariant CNNs on pixelized spheres. These deep networks achieve state-of-the-art results on semantic segmentation for climate data and omnidirectional image processing. Code is available at https://git.io/JGiZA.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 43 of its 60 references that are in the map. First posted on arXiv 12 Jun 2021.
Builds on
43 of 60 references.
References · 43
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017Deep Setscited by 1,421
- 2016Group Equivariant Convolutional Networkscited by 1,165
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
- 2017Dynamic Routing Between Capsulescited by 689
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
- 2018Spherical CNNscited by 456
- 2019General E(2)-Equivariant Steerable CNNscited by 446
- 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 406
- 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 354
- 2018Invariant and Equivariant Graph Networkscited by 346
31 more
- 2016Steerable CNNscited by 305
- 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 300
- 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 295
- 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 267
- 2019Cormorant: Covariant Molecular Neural Networkscited by 263
- 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 248
- 2018A General Theory of Equivariant CNNs on Homogeneous Spacescited by 228
- 2018Clebsch-Gordan Nets: a Fully Fourier Space Spherical Convolutional Neural Networkcited by 171
- 2017Equivariance Through Parameter-Sharingcited by 141
- 2020Lorentz Group Equivariant Neural Network for Particle Physicscited by 121
- 2020LieTransformer: Equivariant self-attention for Lie Groupscited by 100
- 2016Rotation equivariant vector field networkscited by 99
- 2018Roto-Translation Covariant Convolutional Networks for Medical Image Analysiscited by 92
- 2020Gauge Equivariant Mesh CNNs: Anisotropic convolutions on geometric graphscited by 92
- 2020On the Universality of Rotation Equivariant Point Cloud Networkscited by 80
- 2019Spherical CNNs on Unstructured Gridscited by 79
- 2018Deep Models of Interactions Across Setscited by 69
- 2020DeepSphere: a graph-based spherical CNNcited by 66
- 2020Attentive Group Equivariant Convolutional Networkscited by 63
- 2020Group Equivariant Stand-Alone Self-Attention For Visioncited by 63
- 2018DeepSphere: Efficient spherical Convolutional Neural Network with HEALPix sampling for cosmological applicationscited by 62
- 2018Covariant Compositional Networks For Learning Graphscited by 54
- 2019Orientation-aware Semantic Segmentation on Icosahedron Spherescited by 53
- 2020Spin-Weighted Spherical CNNscited by 50
- 2020Universal Equivariant Multilayer Perceptronscited by 49
- 2020A Wigner-Eckart Theorem for Group Equivariant Convolution Kernelscited by 46
- 2018Group Equivariant Capsule Networkscited by 31
- 2020Efficient Generalized Spherical CNNscited by 29
- 2017Learning Spherical Convolution for Fast Features from 360deg Imagerycited by 22
- 2019Incidence Networks for Geometric Deep Learningcited by 17
- 2020Equivariant Maps for Hierarchical Structurescited by 11
Built on by
Citing papers per year: 2022: 8; 2023: 6; 2024: 1; 2025: 1.
16 papers.
Sort:
- 2022Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentationcited by 72
- 2022Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentationcited by 46
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2024Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusioncited by 31
- 2022Equivariance versus Augmentation for Spherical Imagescited by 24
- 2022Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutionscited by 24
- 2022Equivariant Networks for Crystal Structurescited by 24
- 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Visioncited by 24
- 2023Scaling Spherical CNNscited by 21
- 2023HEAL-SWIN: A Vision Transformer On The Spherecited by 20
- 2022Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networkscited by 18
- 2023Making Vision Transformers Truly Shift-Equivariantcited by 16
4 more
- 2023Truly Scale-Equivariant Deep Nets with Fourier Layerscited by 16
- 2022M"obius Convolutions for Spherical CNNscited by 13
- 2023Deep Neural Networks with Efficient Guaranteed Invariancescited by 2
- 2023Spherical Feature Pyramid Networks For Semantic Segmentationcited by 0
- 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Vision11 Feb 2025
- 2024Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusion25 Mar 2024
- 2023Truly Scale-Equivariant Deep Nets with Fourier Layers6 Nov 2023
- 2023HEAL-SWIN: A Vision Transformer On The Sphere14 Jul 2023
- 2023Spherical Feature Pyramid Networks For Semantic Segmentation5 Jul 2023
- 2023Scaling Spherical CNNs8 Jun 2023
- 2023Making Vision Transformers Truly Shift-Equivariant25 May 2023
- 2023Deep Neural Networks with Efficient Guaranteed Invariances2 Mar 2023
- 2022Equivariant Networks for Crystal Structures15 Nov 2022
- 2022Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networks14 Oct 2022
- 2022Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutions27 Sep 2022
- 2022Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentation25 Jul 2022
4 more
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectives21 May 2022
- 2022Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentation2 Mar 2022
- 2022Equivariance versus Augmentation for Spherical Images8 Feb 2022
- 2022M"obius Convolutions for Spherical CNNs28 Jan 2022
- 2022Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentationcited by 72
- 2022Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentationcited by 46
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2024Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusioncited by 31
- 2022Equivariance versus Augmentation for Spherical Imagescited by 24
- 2022Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutionscited by 24
- 2022Equivariant Networks for Crystal Structurescited by 24
- 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Visioncited by 24
- 2023Scaling Spherical CNNscited by 21
- 2023HEAL-SWIN: A Vision Transformer On The Spherecited by 20
- 2022Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networkscited by 18
- 2023Making Vision Transformers Truly Shift-Equivariantcited by 16
12 most cited of 16 All 16 (JSON)
- 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Vision11 Feb 2025
- 2024Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusion25 Mar 2024
- 2023Truly Scale-Equivariant Deep Nets with Fourier Layers6 Nov 2023
- 2023HEAL-SWIN: A Vision Transformer On The Sphere14 Jul 2023
- 2023Spherical Feature Pyramid Networks For Semantic Segmentation5 Jul 2023
- 2023Scaling Spherical CNNs8 Jun 2023
- 2023Making Vision Transformers Truly Shift-Equivariant25 May 2023
- 2023Deep Neural Networks with Efficient Guaranteed Invariances2 Mar 2023
- 2022Equivariant Networks for Crystal Structures15 Nov 2022
- 2022Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networks14 Oct 2022
- 2022Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutions27 Sep 2022
- 2022Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentation25 Jul 2022
12 newest of 16 All 16 (JSON)