Scale-Equivariant Steerable Networks
Not on the map. Why?
Abstract (arXiv)
The effectiveness of Convolutional Neural Networks (CNNs) has been substantially attributed to their built-in property of translation equivariance. However, CNNs do not have embedded mechanisms to handle other types of transformations. In this work, we pay attention to scale changes, which regularly appear in various tasks due to the changing distances between the objects and the camera. First, we introduce the general theory for building scale-equivariant convolutional networks with steerable filters. We develop scale-convolution and generalize other common blocks to be scale-equivariant. We demonstrate the computational efficiency and numerical stability of the proposed method. We compare the proposed models to the previously developed methods for scale equivariance and local scale invariance. We demonstrate state-of-the-art results on MNIST-scale dataset and on STL-10 dataset in the supervised learning setting.
Key facts. Cited by 110 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 29; 2022: 23; 2023: 30; 2024: 12; 2025: 7; 2026: 9.
110 papers.
Sort:
- 2022Approximately Equivariant Networks for Imperfectly Symmetric Dynamicscited by 97
- 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modelingcited by 89
- 2024Neural Operators with Localized Integral and Differential Kernelscited by 62
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detectioncited by 48
- 2021Self-Supervised Learning Disentangled Group Representation as Featurecited by 47
- 2021Learning Partial Equivariances from Datacited by 45
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 44
- 2023Fast, Expressive SE(n) Equivariant Networks through Weight-Sharing in Position-Orientation Spacecited by 41
- 2021DISCO: accurate Discrete Scale Convolutionscited by 36
- 2022Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learningcited by 32
- 2022LieGG: Studying Learned Lie Group Generatorscited by 31
- 2021Equivariant neural networks for inverse problemscited by 29
38 more
- 2022Sample Efficiency of Data Augmentation Consistency Regularizationcited by 28
- 2021Commutative Lie Group VAE for Disentanglement Learningcited by 27
- 2021Resolution learning in deep convolutional networks using scale-space theorycited by 26
- 2022Self-Supervised Equivariant Learning for Oriented Keypoint Detectioncited by 26
- 2024Clifford-Steerable Convolutional Neural Networkscited by 25
- 2021Exploiting Redundancy: Separable Group Convolutional Networks on Lie Groupscited by 22
- 2021Enabling equivariance for arbitrary Lie groupscited by 22
- 2022Maximum Class Separation as Inductive Bias in One Matrixcited by 21
- 2021Dilated convolution with learnable spacingscited by 20
- 2021PDO-eS2CNNs: Partial Differential Operator Based Equivariant Spherical CNNscited by 19
- 20223D Equivariant Graph Implicit Functionscited by 18
- 2023Modelling Long Range Dependencies in ND: From Task-Specific to a General Purpose CNNcited by 18
- 2021Scale-invariant scale-channel networks: Deep networks that generalise to previously unseen scalescited by 17
- 2024Graph Neural PDE Solvers with Conservation and Similarity-Equivariancecited by 17
- 2023Truly Scale-Equivariant Deep Nets with Fourier Layerscited by 16
- 2022Learning Instance-Specific Augmentations by Capturing Local Invariancescited by 15
- 2023Generalizing Neural Human Fitting to Unseen Poses With Articulated SE(3) Equivariancecited by 14
- 2023On genuine invariance learning without weight-tyingcited by 14
- 2022M"obius Convolutions for Spherical CNNscited by 13
- 2022Reflection and Rotation Symmetry Detection via Equivariant Learningcited by 13
- 2022Scale Equivariant U-Netcited by 13
- 2022Equivariant Mesh Attention Networkscited by 12
- 2023Lie Group Decompositions for Equivariant Neural Networkscited by 12
- 2025Probing Equivariance and Symmetry Breaking in Convolutional Networkscited by 12
- 2022Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysiscited by 11
- 2023Scale-Equivariant UNet for Histopathology Image Segmentationcited by 11
- 2021Truly shift-equivariant convolutional neural networks with adaptive polyphase upsamplingcited by 10
- 2023SE(3)-Equivariant and Noise-Invariant 3D Rigid Motion Tracking in Brain MRIcited by 10
- 2022In What Ways Are Deep Neural Networks Invariant and How Should We Measure This?cited by 9
- 2022Robust Perception through Equivariancecited by 9
- 2023ESP: Exploiting Symmetry Prior for Multi-Agent Reinforcement Learningcited by 9
- 2023Covariance properties under natural image transformations for the generalized Gaussian derivative model for visual receptive fieldscited by 8
- 2023Riesz networks: scale invariant neural networks in a single forward passcited by 8
- 2023As large as it gets: Learning infinitely large Filters via Neural Implicit Functions in the Fourier Domaincited by 8
- 2021Deformation Robust Roto-Scale-Translation Equivariant CNNscited by 7
- 2022Improving the Sample-Complexity of Deep Classification Networks with Invariant Integrationcited by 7
- 2023On the Implicit Bias of Linear Equivariant Steerable Networkscited by 7
- 2023Color Equivariant Convolutional Networkscited by 7
50 most cited of 110 All 110 (JSON)
- 2026Neural Renormalization Group Flow for Percolation27 Aug 2026
- 2026Scale-Equivariant Generative Forecasting: Weight-Tied Dilated Convolutions, Wavelet Scattering Inputs, and Spectral-Consistency Training for Self-Similar Time Series17 May 2026
- 2026S2P-Net: A Spectral-Spatial Polar Network for Rotation-Invariant Object Recognition in Low-Data Regimes10 May 2026
- 2026Tunable Soft Equivariance with Guarantees27 Mar 2026
- 2026Scale-invariant Gaussian derivative residual networks3 Mar 2026
- 2026Lie Flow: Video Dynamic Fields Modeling and Predicting with Lie Algebra as Geometric Physics Principle25 Feb 2026
- 2026The geometry of invariant learning: an information-theoretic analysis of data augmentation and generalization16 Feb 2026
- 2026Learning and extrapolating scale-invariant processes21 Jan 2026
- 2026Approximate Equivariance via Projection-based Regularisation8 Jan 2026
- 2025Hybrid Lie semi-group and cascade structures for the generalized Gaussian derivative model for visual receptive fields19 Sep 2025
- 2025CLIPSym: Delving into Symmetry Detection with CLIP19 Aug 2025
- 2025Local Scale Equivariance with Latent Deep Equilibrium Canonicalizer19 Aug 2025
38 more
- 2025Flow Equivariant Recurrent Neural Networks20 Jul 2025
- 2025AdS-GNN -- a Conformally Equivariant Graph Neural Network19 May 2025
- 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modeling13 Feb 2025
- 2025Probing Equivariance and Symmetry Breaking in Convolutional Networks1 Jan 2025
- 2024Harmformer: Harmonic Networks Meet Transformers for Continuous Roto-Translation Equivariance6 Nov 2024
- 2024Scale generalisation properties of extended scale-covariant and scale-invariant Gaussian derivative networks on image datasets with spatial scaling variations17 Sep 2024
- 2024SRE-CNN: A Spatiotemporal Rotation-Equivariant CNN for Cardiac Cine MR Imaging13 Sep 2024
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learning11 Sep 2024
- 2024LAM3D: Leveraging Attention for Monocular 3D Object Detection3 Aug 2024
- 2024Graph Neural PDE Solvers with Conservation and Similarity-Equivariance25 May 2024
- 2024PDE-CNNs: Axiomatic Derivations and Applications22 Mar 2024
- 2024Neural Operators with Localized Integral and Differential Kernels26 Feb 2024
- 2024Efficient 3D affinely equivariant CNNs with adaptive fusion of augmented spherical Fourier-Bessel bases26 Feb 2024
- 2024Hierarchical Invariance for Robust and Interpretable Vision Tasks at Larger Scales23 Feb 2024
- 2024Clifford-Steerable Convolutional Neural Networks22 Feb 2024
- 2024Deep Continuous Networks2 Feb 2024
- 2023SE(3)-Equivariant and Noise-Invariant 3D Rigid Motion Tracking in Brain MRI21 Dec 2023
- 2023Unified theory for joint covariance properties under geometric image transformations for spatio-temporal receptive fields according to the generalized Gaussian derivative model for visual receptive fields17 Nov 2023
- 2023Truly Scale-Equivariant Deep Nets with Fourier Layers6 Nov 2023
- 2023Color Equivariant Convolutional Networks30 Oct 2023
- 2023Lie Group Decompositions for Equivariant Neural Networks17 Oct 2023
- 2023Fast, Expressive SE(n) Equivariant Networks through Weight-Sharing in Position-Orientation Space4 Oct 2023
- 2023Randomized Dimension Reduction with Statistical Guarantees3 Oct 2023
- 2023Improving Equivariance in State-of-the-Art Supervised Depth and Normal Predictors28 Sep 2023
- 2023RSF-Conv: Rotation-and-Scale Equivariant Fourier Parameterized Convolution for Retinal Vessel Segmentation27 Sep 2023
- 2023On genuine invariance learning without weight-tying7 Aug 2023
- 2023ESP: Exploiting Symmetry Prior for Multi-Agent Reinforcement Learning30 Jul 2023
- 2023As large as it gets: Learning infinitely large Filters via Neural Implicit Functions in the Fourier Domain19 Jul 2023
- 2023DUET: 2D Structured and Approximately Equivariant Representations28 Jun 2023
- 2023MEPNet: A Model-Driven Equivariant Proximal Network for Joint Sparse-View Reconstruction and Metal Artifact Reduction in CT Images25 Jun 2023
- 2023Scale-Rotation-Equivariant Lie Group Convolution Neural Networks (Lie Group-CNNs)12 Jun 2023
- 2023Evaluating Machine Learning Models with NERO: Non-Equivariance Revealed on Orbits31 May 2023
- 2023Group Invariant Global Pooling30 May 2023
- 2023Adaptive aggregation of Monte Carlo augmented decomposed filters for efficient group-equivariant convolutional neural network17 May 2023
- 2023Riesz networks: scale invariant neural networks in a single forward pass8 May 2023
- 2023An Exploration of Conditioning Methods in Graph Neural Networks3 May 2023
- 2023Generalizing Neural Human Fitting to Unseen Poses With Articulated SE(3) Equivariance20 Apr 2023
- 2023Scale-Equivariant Deep Learning for 3D Data12 Apr 2023
50 newest of 110 All 110 (JSON)
- 2022Approximately Equivariant Networks for Imperfectly Symmetric Dynamicscited by 97
- 2025EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modelingcited by 89
- 2024Neural Operators with Localized Integral and Differential Kernelscited by 62
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detectioncited by 48
- 2021Self-Supervised Learning Disentangled Group Representation as Featurecited by 47
- 2021Learning Partial Equivariances from Datacited by 45
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 44
- 2023Fast, Expressive SE(n) Equivariant Networks through Weight-Sharing in Position-Orientation Spacecited by 41
- 2021DISCO: accurate Discrete Scale Convolutionscited by 36
- 2022Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learningcited by 32
- 2022LieGG: Studying Learned Lie Group Generatorscited by 31
- 2021Equivariant neural networks for inverse problemscited by 29
12 most cited of 110 All 110 (JSON)
- 2026Neural Renormalization Group Flow for Percolation27 Aug 2026
- 2026Scale-Equivariant Generative Forecasting: Weight-Tied Dilated Convolutions, Wavelet Scattering Inputs, and Spectral-Consistency Training for Self-Similar Time Series17 May 2026
- 2026S2P-Net: A Spectral-Spatial Polar Network for Rotation-Invariant Object Recognition in Low-Data Regimes10 May 2026
- 2026Tunable Soft Equivariance with Guarantees27 Mar 2026
- 2026Scale-invariant Gaussian derivative residual networks3 Mar 2026
- 2026Lie Flow: Video Dynamic Fields Modeling and Predicting with Lie Algebra as Geometric Physics Principle25 Feb 2026
- 2026The geometry of invariant learning: an information-theoretic analysis of data augmentation and generalization16 Feb 2026
- 2026Learning and extrapolating scale-invariant processes21 Jan 2026
- 2026Approximate Equivariance via Projection-based Regularisation8 Jan 2026
- 2025Hybrid Lie semi-group and cascade structures for the generalized Gaussian derivative model for visual receptive fields19 Sep 2025
- 2025CLIPSym: Delving into Symmetry Detection with CLIP19 Aug 2025
- 2025Local Scale Equivariance with Latent Deep Equilibrium Canonicalizer19 Aug 2025
12 newest of 110 All 110 (JSON)