Parametric Scattering Networks
Not on the map. Why?
Abstract (arXiv)
The wavelet scattering transform creates geometric invariants and deformation stability. In multiple signal domains, it has been shown to yield more discriminative representations compared to other non-learned representations and to outperform learned representations in certain tasks, particularly on limited labeled data and highly structured signals. The wavelet filters used in the scattering transform are typically selected to create a tight frame via a parameterized mother wavelet. In this work, we investigate whether this standard wavelet filterbank construction is optimal. Focusing on Morlet wavelets, we propose to learn the scales, orientations, and aspect ratios of the filters to produce problem-specific parameterizations of the scattering transform. We show that our learned versions of the scattering transform yield significant performance gains in small-sample classification settings over the standard scattering transform. Moreover, our empirical results suggest that traditional filterbank constructions may not always be necessary for scattering transforms to extract effective representations.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 59 of its 131 references that are in the map. First posted on arXiv 20 Jul 2021.
Builds on
59 of 131 references.
References · 59
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2014Going Deeper with Convolutionscited by 4,231
- 2016Wide Residual Networkscited by 3,057
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2016Colorful Image Colorizationcited by 1,113
38 more
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
- 2018AutoAugment: Learning Augmentation Policies from Datacited by 728
- 2017One pixel attack for fooling deep neural networkscited by 579
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
- 2018How Does Batch Normalization Help Optimization?cited by 355
- 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 293
- 2020COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest X-Ray Imagescited by 264
- 2017Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Ratescited by 196
- 2020On Translation Invariance in CNNs: Convolutional Layers can Exploit Absolute Spatial Locationcited by 141
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2018Data Augmentation by Pairing Samples for Images Classificationcited by 96
- 2016Understanding Deep Convolutional Networkscited by 76
- 2020Deep-COVID: Predicting COVID-19 From Chest X-Ray Images Using Deep Transfer Learningcited by 67
- 2015Sliced Wasserstein Kernels for Probability Distributionscited by 64
- 2018Kymatio: Scattering Transforms in Pythoncited by 54
- 2013Deep Scattering Spectrumcited by 52
- 2014Rigid-Motion Scattering for Texture Classificationcited by 52
- 2014Deep Roto-Translation Scattering for Object Classificationcited by 49
- 2018Geometric Scattering for Graph Data Analysiscited by 49
- 2018Graph Convolutional Neural Networks via Scatteringcited by 46
- 2020Automatic Shortcut Removal for Self-Supervised Representation Learningcited by 43
- 2019Deep Learning on Small Datasets without Pre-Training using Cosine Losscited by 41
- 2017OL'E: Orthogonal Low-rank Embedding, A Plug and Play Geometric Loss for Deep Learningcited by 37
- 2017Scaling the Scattering Transform: Deep Hybrid Networkscited by 35
- 2017ISIC 2017 - Skin Lesion Analysis Towards Melanoma Detectioncited by 34
- 2018Scattering Networks for Hybrid Representation Learningcited by 33
- 2016Structured Receptive Fields in CNNscited by 32
- 2020Learning from Few Samples: A Surveycited by 23
- 2021Scattering Networks on the Sphere for Scalable and Rotationally Equivariant Spherical CNNscited by 18
- 2019GaborNet: Gabor filters with learnable parameters in deep convolutional neural networkscited by 17
- 2018Adversarial Framing for Image and Video Classificationcited by 15
- 2018Solid Harmonic Wavelet Scattering for Predictions of Molecule Propertiescited by 12
- 2018Joint Time-Frequency Scatteringcited by 11
- 2021VIPriors 1: Visual Inductive Priors for Data-Efficient Deep Learning Challengescited by 11
- 2017Understanding the Mechanisms of Deep Transfer Learning for Medical Imagescited by 10
- 2019A Learnable ScatterNet: Locally Invariant Convolutional Layerscited by 10
- 2015Joint Time-Frequency Scattering for Audio Classificationcited by 8
- 2016Wavelet Scattering Regression of Quantum Chemical Energiescited by 8
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2022: 5; 2023: 4; 2024: 1; 2025: 2; 2026: 3.
15 papers.
Sort:
- 2022Neural Fourier Filter Bankcited by 29
- 2024Occam's Razor for Self Supervised Learning: What is Sufficient to Learn Good Representations?cited by 8
- 2022ChimeraMix: Image Classification on Small Datasets via Masked Feature Mixingcited by 4
- 2023Riesz feature representation: scale equivariant scattering network for classification taskscited by 4
- 2022On the Shift Invariance of Max Pooling Feature Maps in Convolutional Neural Networkscited by 2
- 2022Differentiable Time-Frequency Scattering on GPUcited by 1
- 2023No Data Augmentation? Alternative Regularizations for Effective Training on Small Datasetscited by 1
- 2022From CNNs to Shift-Invariant Twin Models Based on Complex Waveletscited by 0
- 2023Invariant Scattering Transform for Medical Imagingcited by 0
- 2023Learnable wavelet neural networks for cosmological inferencecited by 0
- 2025Scattering Networks on Noncommutative Finite Groupscited by 0
- 2025Learning Object-Centric Representations in SAR Images with Multi-Level Feature Fusioncited by 0
3 more
- 2026Transversal Pooling Neural Networks28 Sep 2026
- 2026Bayesian Scattering: A Principled Baseline for Uncertainty on Image Data21 Mar 2026
- 2026SCRAPL: Scattering Transform with Random Paths for Machine Learning11 Feb 2026
- 2025Learning Object-Centric Representations in SAR Images with Multi-Level Feature Fusion11 Sep 2025
- 2025Scattering Networks on Noncommutative Finite Groups27 May 2025
- 2024Occam's Razor for Self Supervised Learning: What is Sufficient to Learn Good Representations?15 Jun 2024
- 2023No Data Augmentation? Alternative Regularizations for Effective Training on Small Datasets4 Sep 2023
- 2023Learnable wavelet neural networks for cosmological inference24 Jul 2023
- 2023Riesz feature representation: scale equivariant scattering network for classification tasks17 Jul 2023
- 2023Invariant Scattering Transform for Medical Imaging7 Jul 2023
- 2022Neural Fourier Filter Bank4 Dec 2022
- 2022From CNNs to Shift-Invariant Twin Models Based on Complex Wavelets1 Dec 2022
- 2022Neural Fourier Filter Bankcited by 29
- 2024Occam's Razor for Self Supervised Learning: What is Sufficient to Learn Good Representations?cited by 8
- 2022ChimeraMix: Image Classification on Small Datasets via Masked Feature Mixingcited by 4
- 2023Riesz feature representation: scale equivariant scattering network for classification taskscited by 4
- 2022On the Shift Invariance of Max Pooling Feature Maps in Convolutional Neural Networkscited by 2
- 2022Differentiable Time-Frequency Scattering on GPUcited by 1
- 2023No Data Augmentation? Alternative Regularizations for Effective Training on Small Datasetscited by 1
- 2022From CNNs to Shift-Invariant Twin Models Based on Complex Waveletscited by 0
- 2023Invariant Scattering Transform for Medical Imagingcited by 0
- 2023Learnable wavelet neural networks for cosmological inferencecited by 0
- 2025Scattering Networks on Noncommutative Finite Groupscited by 0
- 2025Learning Object-Centric Representations in SAR Images with Multi-Level Feature Fusioncited by 0
12 most cited of 15 All 15 (JSON)
- 2026Transversal Pooling Neural Networks28 Sep 2026
- 2026Bayesian Scattering: A Principled Baseline for Uncertainty on Image Data21 Mar 2026
- 2026SCRAPL: Scattering Transform with Random Paths for Machine Learning11 Feb 2026
- 2025Learning Object-Centric Representations in SAR Images with Multi-Level Feature Fusion11 Sep 2025
- 2025Scattering Networks on Noncommutative Finite Groups27 May 2025
- 2024Occam's Razor for Self Supervised Learning: What is Sufficient to Learn Good Representations?15 Jun 2024
- 2023No Data Augmentation? Alternative Regularizations for Effective Training on Small Datasets4 Sep 2023
- 2023Learnable wavelet neural networks for cosmological inference24 Jul 2023
- 2023Riesz feature representation: scale equivariant scattering network for classification tasks17 Jul 2023
- 2023Invariant Scattering Transform for Medical Imaging7 Jul 2023
- 2022Neural Fourier Filter Bank4 Dec 2022
- 2022From CNNs to Shift-Invariant Twin Models Based on Complex Wavelets1 Dec 2022
12 newest of 15 All 15 (JSON)