DeepSphere: Efficient spherical Convolutional Neural Network with HEALPix sampling for cosmological applications
Not on the map. Why?
Abstract (arXiv)
Convolutional Neural Networks (CNNs) are a cornerstone of the Deep Learning toolbox and have led to many breakthroughs in Artificial Intelligence. These networks have mostly been developed for regular Euclidean domains such as those supporting images, audio, or video. Because of their success, CNN-based methods are becoming increasingly popular in Cosmology. Cosmological data often comes as spherical maps, which make the use of the traditional CNNs more complicated. The commonly used pixelization scheme for spherical maps is the Hierarchical Equal Area isoLatitude Pixelisation (HEALPix). We present a spherical CNN for analysis of full and partial HEALPix maps, which we call DeepSphere. The spherical CNN is constructed by representing the sphere as a graph. Graphs are versatile data structures that can act as a discrete representation of a continuous manifold. Using the graph-based representation, we define many of the standard CNN operations, such as convolution and pooling. With filters restricted to being radial, our convolutions are equivariant to rotation on the sphere, and DeepSphere can be made invariant or equivariant to rotation. This way, DeepSphere is a special case of a graph CNN, tailored to the HEALPix sampling of the sphere. This approach is computationally more efficient than using spherical harmonics to perform convolutions. We demonstrate the method on a classification problem of weak lensing mass maps from two cosmological models and compare the performance of the CNN with that of two baseline classifiers. The results show that the performance of DeepSphere is always superior or equal to both of these baselines. For high noise levels and for data covering only a smaller fraction of the sphere, DeepSphere achieves typically 10% better classification accuracy than those baselines. Finally, we show how learned filters can be visualized to introspect the neural network.
Key facts. Cited by 62 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 11; 2023: 9; 2024: 7; 2025: 7; 2026: 8.
62 papers.
Sort:
By area:
- 2021Spherical Message Passing for 3D Graph Networkscited by 168
- 2021Hyperbolic Deep Neural Networks: A Surveycited by 139
- 2021Geometric Deep Learning and Equivariant Neural Networkscited by 65
- 2022Surround-view Fisheye Camera Perception for Automated Driving: Overview, Survey and Challengescited by 34
- 2021Applications and Techniques for Fast Machine Learning in Sciencecited by 32
- 2022GNN-Surrogate: A Hierarchical and Adaptive Graph Neural Network for Parameter Space Exploration of Unstructured-Mesh Ocean Simulationscited by 32
- 2022Guided Co-Modulated GAN for 360deg Field of View Extrapolationcited by 32
- 2022Spherical Sliced-Wassersteincited by 31
- 2021Conditional Local Convolution for Spatio-temporal Meteorological Forecastingcited by 30
- 2023Advancing Parsimonious Deep Learning Weather Prediction using the HEALPix Meshcited by 28
- 2022Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutionscited by 24
- 2023Scaling Spherical CNNscited by 21
38 more
- 2023HEAL-SWIN: A Vision Transformer On The Spherecited by 20
- 2021PDO-eS2CNNs: Partial Differential Operator Based Equivariant Spherical CNNscited by 19
- 2021Scattering Networks on the Sphere for Scalable and Rotationally Equivariant Spherical CNNscited by 18
- 2021Equivariant Networks for Pixelized Spherescited by 16
- 2021A neural simulation-based inference approach for characterizing the Galactic Center γ-ray excesscited by 12
- 2024Diffusion MRI with Machine Learningcited by 11
- 2021Equivariant Spherical Deconvolution: Learning Sparse Orientation Distribution Functions from Spherical Datacited by 10
- 2021DeepAdversaries: Examining the Robustness of Deep Learning Models for Galaxy Morphology Classificationcited by 10
- 2023Exploiting Code Symmetries for Learning Program Semanticscited by 10
- 2024HEAL-ViT: Vision Transformers on a spherical mesh for medium-range weather forecastingcited by 8
- 2021OSLO: On-the-Sphere Learning for Omnidirectional images and its application to 360-degree image compressioncited by 7
- 2021Pseudocylindrical Convolutions for Learned Omnidirectional Image Compressioncited by 6
- 2022Machine Learning and Cosmologycited by 6
- 2021Quantum algorithms for group convolution, cross-correlation, and equivariant transformationscited by 5
- 2024Estimating Depth of Monocular Panoramic Image with Teacher-Student Model Fusing Equirectangular and Spherical Representationscited by 5
- 2025PEAR: Equal Area Weather Forecasting on the Spherecited by 5
- 2021Inferring dark matter substructure with astrometric lensing beyond the power spectrumcited by 4
- 2022Neural Networks Optimized by Genetic Algorithms in Cosmologycited by 4
- 2023Real-Time Neural BRDF with Spherically Distributed Primitivescited by 4
- 2024Equivariant Neural Tangent Kernelscited by 4
- 2022Direction of Arrival Estimation of Sound Sources Using Icosahedral CNNscited by 3
- 2025Fast Omni-Directional Image Super-Resolution: Adapting the Implicit Image Function with Pixel and Semantic-Wise Spherical Geometric Priorscited by 3
- 2025Score-based generative emulation of impact-relevant Earth system model outputscited by 3
- 2021Dim but not entirely dark: Extracting the Galactic Center Excess' source-count distribution with neural netscited by 2
- 2021Capacity of Group-invariant Linear Readouts from Equivariant Representations: How Many Objects can be Linearly Classified Under All Possible Views?cited by 2
- 2022Spherical convolutional neural networks can improve brain microstructure estimation from diffusion MRI datacited by 2
- 2023Learning to Transform for Generalizable Instance-wise Invariancecited by 2
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learningcited by 2
- 2025Spherical Tree-Sliced Wasserstein Distancecited by 2
- 2026SO3UFormer: Learning Intrinsic Spherical Features for Rotation-Robust Panoramic Dense Predictioncited by 2
- 2021Spherical Transformer: Adapting Spherical Signal to CNNscited by 1
- 2021ChebLieNet: Invariant Spectral Graph NNs Turned Equivariant by Riemannian Geometry on Lie Groupscited by 1
- 2022Hierarchical Spherical CNNs with Lifting-based Adaptive Wavelets for Pooling and Unpoolingcited by 1
- 2023Cosmic Microwave Background Recovery: A Graph-Based Bayesian Convolutional Network Approachcited by 1
- 2023E(3) × SO(3)-Equivariant Networks for Spherical Deconvolution in Diffusion MRIcited by 1
- 2024Equivariant spatio-hemispherical networks for diffusion MRI deconvolutioncited by 1
- 2025360-Degree Full-view Image Segmentation by Spherical Convolution compatible with Large-scale Planar Pre-trained Modelscited by 1
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modelingcited by 1
50 most cited of 62 All 62 (JSON)
- 2026S3N: A Spherical Spiral Scanning Network for Weather Forecasting3 Oct 2026
- 2026Rate-Distortion Adaptive Primitive Selection for Omnidirectional Gaussian Splatting28 Sep 2026
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modeling26 Jun 2026
- 2026Velocityformer: Broken-Symmetry-Matched Equivariant Graph Transformers for Cosmological Velocity Reconstruction20 May 2026
- 2026SO3UFormer: Learning Intrinsic Spherical Features for Rotation-Robust Panoramic Dense Prediction26 Feb 2026
- 2026Spectral Diffusion Models on the Sphere28 Jan 2026
- 2026Cross360: 360deg Monocular Depth Estimation via Cross Projections Across Scales24 Jan 2026
- 2026Neural Operators for Biomedical Spherical Heterogeneity7 Jan 2026
- 2025Dark Energy Survey Year 3 results: Simulation-based wCDM inference from weak lensing and galaxy clustering maps with deep learning: Analysis design6 Nov 2025
- 2025Bayesian Inference of Primordial Magnetic Field Parameters from CMB with Spherical Graph Neural Networks23 Oct 2025
- 2025Score-based generative emulation of impact-relevant Earth system model outputs5 Oct 2025
- 2025360-Degree Full-view Image Segmentation by Spherical Convolution compatible with Large-scale Planar Pre-trained Models12 Jul 2025
38 more
- 2025PEAR: Equal Area Weather Forecasting on the Sphere23 May 2025
- 2025Spherical Tree-Sliced Wasserstein Distance14 Mar 2025
- 2025Fast Omni-Directional Image Super-Resolution: Adapting the Implicit Image Function with Pixel and Semantic-Wise Spherical Geometric Priors9 Feb 2025
- 2024Equivariant spatio-hemispherical networks for diffusion MRI deconvolution18 Nov 2024
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learning11 Sep 2024
- 2024Equivariant Neural Tangent Kernels10 Jun 2024
- 2024Estimating Depth of Monocular Panoramic Image with Teacher-Student Model Fusing Equirectangular and Spherical Representations27 May 2024
- 2024HEAL-ViT: Vision Transformers on a spherical mesh for medium-range weather forecasting14 Feb 2024
- 2024A deep learning framework for jointly extracting spectra and source-count distributions in astronomy6 Jan 2024
- 2024Diffusion MRI with Machine Learning1 Jan 2024
- 2023Real-Time Neural BRDF with Spherically Distributed Primitives12 Oct 2023
- 2023Learning to Transform for Generalizable Instance-wise Invariance28 Sep 2023
- 2023Advancing Parsimonious Deep Learning Weather Prediction using the HEALPix Mesh11 Sep 2023
- 2023Exploiting Code Symmetries for Learning Program Semantics7 Aug 2023
- 2023HEAL-SWIN: A Vision Transformer On The Sphere14 Jul 2023
- 2023Spherical Feature Pyramid Networks For Semantic Segmentation5 Jul 2023
- 2023Scaling Spherical CNNs8 Jun 2023
- 2023E(3) × SO(3)-Equivariant Networks for Spherical Deconvolution in Diffusion MRI12 Apr 2023
- 2023Cosmic Microwave Background Recovery: A Graph-Based Bayesian Convolutional Network Approach24 Feb 2023
- 2022Spherical convolutional neural networks can improve brain microstructure estimation from diffusion MRI data17 Nov 2022
- 2022Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutions27 Sep 2022
- 2022Neural Networks Optimized by Genetic Algorithms in Cosmology6 Sep 2022
- 2022Spherical Sliced-Wasserstein17 Jun 2022
- 2022Hierarchical Spherical CNNs with Lifting-based Adaptive Wavelets for Pooling and Unpooling31 May 2022
- 2022Surround-view Fisheye Camera Perception for Automated Driving: Overview, Survey and Challenges26 May 2022
- 2022Guided Co-Modulated GAN for 360deg Field of View Extrapolation15 Apr 2022
- 2022GORDA: Graph-based ORientation Distribution Analysis of SLI scatterometry Patterns of Nerve Fibres12 Apr 2022
- 2022Direction of Arrival Estimation of Sound Sources Using Icosahedral CNNs31 Mar 2022
- 2022Machine Learning and Cosmology15 Mar 2022
- 2022GNN-Surrogate: A Hierarchical and Adaptive Graph Neural Network for Parameter Space Exploration of Unstructured-Mesh Ocean Simulations18 Feb 2022
- 2021DeepAdversaries: Examining the Robustness of Deep Learning Models for Galaxy Morphology Classification28 Dec 2021
- 2021Pseudocylindrical Convolutions for Learned Omnidirectional Image Compression25 Dec 2021
- 2021Gaussian map predictions for 3D surface feature localisation and counting7 Dec 2021
- 2021ChebLieNet: Invariant Spectral Graph NNs Turned Equivariant by Riemannian Geometry on Lie Groups23 Nov 2021
- 2021Applications and Techniques for Fast Machine Learning in Science25 Oct 2021
- 2021Capacity of Group-invariant Linear Readouts from Equivariant Representations: How Many Objects can be Linearly Classified Under All Possible Views?14 Oct 2021
- 2021A neural simulation-based inference approach for characterizing the Galactic Center γ-ray excess13 Oct 2021
- 2021Inferring dark matter substructure with astrometric lensing beyond the power spectrum4 Oct 2021
50 newest of 62 All 62 (JSON)
- 2026Spectral Diffusion Models on the Spherecited by 0
- 2026Spectral Diffusion Models on the Sphere28 Jan 2026
- 2021Spherical Message Passing for 3D Graph Networkscited by 168
- 2021Hyperbolic Deep Neural Networks: A Surveycited by 139
- 2021Geometric Deep Learning and Equivariant Neural Networkscited by 65
- 2022Surround-view Fisheye Camera Perception for Automated Driving: Overview, Survey and Challengescited by 34
- 2021Applications and Techniques for Fast Machine Learning in Sciencecited by 32
- 2022GNN-Surrogate: A Hierarchical and Adaptive Graph Neural Network for Parameter Space Exploration of Unstructured-Mesh Ocean Simulationscited by 32
- 2022Guided Co-Modulated GAN for 360deg Field of View Extrapolationcited by 32
- 2022Spherical Sliced-Wassersteincited by 31
- 2021Conditional Local Convolution for Spatio-temporal Meteorological Forecastingcited by 30
- 2023Advancing Parsimonious Deep Learning Weather Prediction using the HEALPix Meshcited by 28
- 2022Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutionscited by 24
- 2023Scaling Spherical CNNscited by 21
12 most cited of 61 All 61 (JSON)
- 2026S3N: A Spherical Spiral Scanning Network for Weather Forecasting3 Oct 2026
- 2026Rate-Distortion Adaptive Primitive Selection for Omnidirectional Gaussian Splatting28 Sep 2026
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modeling26 Jun 2026
- 2026Velocityformer: Broken-Symmetry-Matched Equivariant Graph Transformers for Cosmological Velocity Reconstruction20 May 2026
- 2026SO3UFormer: Learning Intrinsic Spherical Features for Rotation-Robust Panoramic Dense Prediction26 Feb 2026
- 2026Cross360: 360deg Monocular Depth Estimation via Cross Projections Across Scales24 Jan 2026
- 2026Neural Operators for Biomedical Spherical Heterogeneity7 Jan 2026
- 2025Dark Energy Survey Year 3 results: Simulation-based wCDM inference from weak lensing and galaxy clustering maps with deep learning: Analysis design6 Nov 2025
- 2025Bayesian Inference of Primordial Magnetic Field Parameters from CMB with Spherical Graph Neural Networks23 Oct 2025
- 2025Score-based generative emulation of impact-relevant Earth system model outputs5 Oct 2025
- 2025360-Degree Full-view Image Segmentation by Spherical Convolution compatible with Large-scale Planar Pre-trained Models12 Jul 2025
- 2025PEAR: Equal Area Weather Forecasting on the Sphere23 May 2025
12 newest of 61 All 61 (JSON)