Scale-Invariant Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
Even though convolutional neural networks (CNN) has achieved near-human performance in various computer vision tasks, its ability to tolerate scale variations is limited. The popular practise is making the model bigger first, and then train it with data augmentation using extensive scale-jittering. In this paper, we propose a scaleinvariant convolutional neural network (SiCNN), a modeldesigned to incorporate multi-scale feature exaction and classification into the network structure. SiCNN uses a multi-column architecture, with each column focusing on a particular scale. Unlike previous multi-column strategies, these columns share the same set of filter parameters by a scale transformation among them. This design deals with scale variation without blowing up the model size. Experimental results show that SiCNN detects features at various scales, and the classification result exhibits strong robustness against object scale variations.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Nov 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 7; 2023: 15; 2024: 5; 2025: 4; 2026: 3.
40 papers.
Sort:
- 2022Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlapcited by 105
- 2024Neural Operators with Localized Integral and Differential Kernelscited by 59
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detectioncited by 48
- 2021DISCO: accurate Discrete Scale Convolutionscited by 35
- 2022Text2Light: Zero-Shot Text-Driven HDR Panorama Generationcited by 24
- 2021Scale-invariant scale-channel networks: Deep networks that generalise to previously unseen scalescited by 17
- 2023Scale-Equivariant UNet for Histopathology Image Segmentationcited by 11
- 2021Learning Online Visual Invariances for Novel Objects via Supervised and Self-Supervised Trainingcited by 10
- 2023Riesz networks: scale invariant neural networks in a single forward passcited by 8
- 2021Deformation Robust Roto-Scale-Translation Equivariant CNNscited by 7
- 2022Improving the Sample-Complexity of Deep Classification Networks with Invariant Integrationcited by 7
- 2023Scale-Equivariant Deep Learning for 3D Datacited by 6
28 more
- 2023Steerable Equivariant Representation Learningcited by 5
- 2023RSF-Conv: Rotation-and-Scale Equivariant Fourier Parameterized Convolution for Retinal Vessel Segmentationcited by 5
- 2021Downbeat Tracking with Tempo-Invariant Convolutional Neural Networkscited by 4
- 2021CNN-based Ego-Motion Estimation for Fast MAV Maneuverscited by 3
- 2024Scale generalisation properties of extended scale-covariant and scale-invariant Gaussian derivative networks on image datasets with spatial scaling variationscited by 3
- 2025Overtone: Cyclic Patch Modulation for Clean, Efficient, and Flexible Physics Emulatorscited by 3
- 2022Just a Matter of Scale? Reevaluating Scale Equivariance in Convolutional Neural Networkscited by 2
- 2023Deep Neural Networks with Efficient Guaranteed Invariancescited by 2
- 2023Scale-Rotation-Equivariant Lie Group Convolution Neural Networks (Lie Group-CNNs)cited by 2
- 2023Scale-Preserving Automatic Concept Extraction (SPACE)cited by 2
- 2025Local Scale Equivariance with Latent Deep Equilibrium Canonicalizercited by 2
- 2025Generalized Spherical Neural Operators: Green's Function Formulationcited by 2
- 2022Scalar Invariant Networks with Zero Biascited by 1
- 2023Machine Learning-based Signal Quality Assessment for Cardiac Volume Monitoring in Electrical Impedance Tomographycited by 1
- 2023Hawk: An Industrial-strength Multi-label Document Classifiercited by 1
- 2023SO(2) and O(2) Equivariance in Image Recognition with Bessel-Convolutional Neural Networkscited by 1
- 2023Evaluating Machine Learning Models with NERO: Non-Equivariance Revealed on Orbitscited by 1
- 2023Advancing Perception in Artificial Intelligence through Principles of Cognitive Sciencecited by 1
- 2024Investigation to answer three key questions concerning plant pest identification and development of a practical identification frameworkcited by 1
- 2022Scale dependant layer for self-supervised nuclei encodingcited by 0
- 2023Restore Translation Using Equivariant Neural Networkscited by 0
- 2023Unveiling Invariances via Neural Network Pruningcited by 0
- 2024Retina Vision Transformer (RetinaViT): Introducing Scaled Patches into Vision Transformerscited by 0
- 2024Multi-scale Unified Network for Image Classificationcited by 0
- 2025GASPnet: Global Agreement to Synchronize Phasescited by 0
- 2026Neural Operators for Biomedical Spherical Heterogeneitycited by 0
- 2026Scale-invariant Gaussian derivative residual networkscited by 0
- 2026Distilling Latent Manifolds: Resolution Extrapolation by Variational Autoencoderscited by 0
- 2026Distilling Latent Manifolds: Resolution Extrapolation by Variational Autoencoders15 Mar 2026
- 2026Scale-invariant Gaussian derivative residual networks3 Mar 2026
- 2026Neural Operators for Biomedical Spherical Heterogeneity7 Jan 2026
- 2025Generalized Spherical Neural Operators: Green's Function Formulation11 Dec 2025
- 2025Local Scale Equivariance with Latent Deep Equilibrium Canonicalizer19 Aug 2025
- 2025GASPnet: Global Agreement to Synchronize Phases22 Jul 2025
- 2025Overtone: Cyclic Patch Modulation for Clean, Efficient, and Flexible Physics Emulators12 Jul 2025
- 2024Scale generalisation properties of extended scale-covariant and scale-invariant Gaussian derivative networks on image datasets with spatial scaling variations17 Sep 2024
- 2024Investigation to answer three key questions concerning plant pest identification and development of a practical identification framework25 Jul 2024
- 2024Multi-scale Unified Network for Image Classification27 Mar 2024
- 2024Retina Vision Transformer (RetinaViT): Introducing Scaled Patches into Vision Transformers20 Mar 2024
- 2024Neural Operators with Localized Integral and Differential Kernels26 Feb 2024
28 more
- 2023Advancing Perception in Artificial Intelligence through Principles of Cognitive Science13 Oct 2023
- 2023RSF-Conv: Rotation-and-Scale Equivariant Fourier Parameterized Convolution for Retinal Vessel Segmentation27 Sep 2023
- 2023Unveiling Invariances via Neural Network Pruning15 Sep 2023
- 2023Scale-Preserving Automatic Concept Extraction (SPACE)11 Aug 2023
- 2023Restore Translation Using Equivariant Neural Networks29 Jun 2023
- 2023Scale-Rotation-Equivariant Lie Group Convolution Neural Networks (Lie Group-CNNs)12 Jun 2023
- 2023Evaluating Machine Learning Models with NERO: Non-Equivariance Revealed on Orbits31 May 2023
- 2023Riesz networks: scale invariant neural networks in a single forward pass8 May 2023
- 2023SO(2) and O(2) Equivariance in Image Recognition with Bessel-Convolutional Neural Networks18 Apr 2023
- 2023Scale-Equivariant Deep Learning for 3D Data12 Apr 2023
- 2023Scale-Equivariant UNet for Histopathology Image Segmentation10 Apr 2023
- 2023Deep Neural Networks with Efficient Guaranteed Invariances2 Mar 2023
- 2023Steerable Equivariant Representation Learning22 Feb 2023
- 2023Hawk: An Industrial-strength Multi-label Document Classifier15 Jan 2023
- 2023Machine Learning-based Signal Quality Assessment for Cardiac Volume Monitoring in Electrical Impedance Tomography4 Jan 2023
- 2022Just a Matter of Scale? Reevaluating Scale Equivariance in Convolutional Neural Networks18 Nov 2022
- 2022Scalar Invariant Networks with Zero Bias15 Nov 2022
- 2022Text2Light: Zero-Shot Text-Driven HDR Panorama Generation20 Sep 2022
- 2022Scale dependant layer for self-supervised nuclei encoding22 Jul 2022
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detection21 Jul 2022
- 2022Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap25 Mar 2022
- 2022Improving the Sample-Complexity of Deep Classification Networks with Invariant Integration8 Feb 2022
- 2021Deformation Robust Roto-Scale-Translation Equivariant CNNs22 Nov 2021
- 2021Learning Online Visual Invariances for Novel Objects via Supervised and Self-Supervised Training4 Oct 2021
- 2021Scale-invariant scale-channel networks: Deep networks that generalise to previously unseen scales11 Jun 2021
- 2021DISCO: accurate Discrete Scale Convolutions4 Jun 2021
- 2021Downbeat Tracking with Tempo-Invariant Convolutional Neural Networks3 Feb 2021
- 2021CNN-based Ego-Motion Estimation for Fast MAV Maneuvers6 Jan 2021
- 2022Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlapcited by 105
- 2024Neural Operators with Localized Integral and Differential Kernelscited by 59
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detectioncited by 48
- 2021DISCO: accurate Discrete Scale Convolutionscited by 35
- 2022Text2Light: Zero-Shot Text-Driven HDR Panorama Generationcited by 24
- 2021Scale-invariant scale-channel networks: Deep networks that generalise to previously unseen scalescited by 17
- 2023Scale-Equivariant UNet for Histopathology Image Segmentationcited by 11
- 2021Learning Online Visual Invariances for Novel Objects via Supervised and Self-Supervised Trainingcited by 10
- 2023Riesz networks: scale invariant neural networks in a single forward passcited by 8
- 2021Deformation Robust Roto-Scale-Translation Equivariant CNNscited by 7
- 2022Improving the Sample-Complexity of Deep Classification Networks with Invariant Integrationcited by 7
- 2023Scale-Equivariant Deep Learning for 3D Datacited by 6
12 most cited of 40 All 40 (JSON)
- 2026Distilling Latent Manifolds: Resolution Extrapolation by Variational Autoencoders15 Mar 2026
- 2026Scale-invariant Gaussian derivative residual networks3 Mar 2026
- 2026Neural Operators for Biomedical Spherical Heterogeneity7 Jan 2026
- 2025Generalized Spherical Neural Operators: Green's Function Formulation11 Dec 2025
- 2025Local Scale Equivariance with Latent Deep Equilibrium Canonicalizer19 Aug 2025
- 2025GASPnet: Global Agreement to Synchronize Phases22 Jul 2025
- 2025Overtone: Cyclic Patch Modulation for Clean, Efficient, and Flexible Physics Emulators12 Jul 2025
- 2024Scale generalisation properties of extended scale-covariant and scale-invariant Gaussian derivative networks on image datasets with spatial scaling variations17 Sep 2024
- 2024Investigation to answer three key questions concerning plant pest identification and development of a practical identification framework25 Jul 2024
- 2024Multi-scale Unified Network for Image Classification27 Mar 2024
- 2024Retina Vision Transformer (RetinaViT): Introducing Scaled Patches into Vision Transformers20 Mar 2024
- 2024Neural Operators with Localized Integral and Differential Kernels26 Feb 2024
12 newest of 40 All 40 (JSON)