mlsanityData to 7 Oct 2026

Parametric Scattering Networks

arXiv 2107.09539 ↗First posted 20 Jul 2021cs.LG eess.SPcited by 15

Not on the map. Why?

Abstract (arXiv)

The wavelet scattering transform creates geometric invariants and deformation stability. In multiple signal domains, it has been shown to yield more discriminative representations compared to other non-learned representations and to outperform learned representations in certain tasks, particularly on limited labeled data and highly structured signals. The wavelet filters used in the scattering transform are typically selected to create a tight frame via a parameterized mother wavelet. In this work, we investigate whether this standard wavelet filterbank construction is optimal. Focusing on Morlet wavelets, we propose to learn the scales, orientations, and aspect ratios of the filters to produce problem-specific parameterizations of the scattering transform. We show that our learned versions of the scattering transform yield significant performance gains in small-sample classification settings over the standard scattering transform. Moreover, our empirical results suggest that traditional filterbank constructions may not always be necessary for scattering transforms to extract effective representations.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 59 of its 131 references that are in the map. First posted on arXiv 20 Jul 2021.

Builds on

59 of 131 references.

References · 59

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  5. 2016Densely Connected Convolutional Networkscited by 6,691
  6. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  7. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  8. 2014Going Deeper with Convolutionscited by 4,231
  9. 2016Wide Residual Networkscited by 3,057
  10. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  11. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
  12. 2016Colorful Image Colorizationcited by 1,113
38 more
  1. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
  2. 2018AutoAugment: Learning Augmentation Policies from Datacited by 728
  3. 2017One pixel attack for fooling deep neural networkscited by 579
  4. 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
  5. 2018How Does Batch Normalization Help Optimization?cited by 355
  6. 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 293
  7. 2020COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest X-Ray Imagescited by 264
  8. 2017Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Ratescited by 196
  9. 2020On Translation Invariance in CNNs: Convolutional Layers can Exploit Absolute Spatial Locationcited by 141
  10. 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
  11. 2018Data Augmentation by Pairing Samples for Images Classificationcited by 96
  12. 2016Understanding Deep Convolutional Networkscited by 76
  13. 2020Deep-COVID: Predicting COVID-19 From Chest X-Ray Images Using Deep Transfer Learningcited by 67
  14. 2015Sliced Wasserstein Kernels for Probability Distributionscited by 64
  15. 2018Kymatio: Scattering Transforms in Pythoncited by 54
  16. 2013Deep Scattering Spectrumcited by 52
  17. 2014Rigid-Motion Scattering for Texture Classificationcited by 52
  18. 2014Deep Roto-Translation Scattering for Object Classificationcited by 49
  19. 2018Geometric Scattering for Graph Data Analysiscited by 49
  20. 2018Graph Convolutional Neural Networks via Scatteringcited by 46
  21. 2020Automatic Shortcut Removal for Self-Supervised Representation Learningcited by 43
  22. 2019Deep Learning on Small Datasets without Pre-Training using Cosine Losscited by 41
  23. 2017OL'E: Orthogonal Low-rank Embedding, A Plug and Play Geometric Loss for Deep Learningcited by 37
  24. 2017Scaling the Scattering Transform: Deep Hybrid Networkscited by 35
  25. 2017ISIC 2017 - Skin Lesion Analysis Towards Melanoma Detectioncited by 34
  26. 2018Scattering Networks for Hybrid Representation Learningcited by 33
  27. 2016Structured Receptive Fields in CNNscited by 32
  28. 2020Learning from Few Samples: A Surveycited by 23
  29. 2021Scattering Networks on the Sphere for Scalable and Rotationally Equivariant Spherical CNNscited by 18
  30. 2019GaborNet: Gabor filters with learnable parameters in deep convolutional neural networkscited by 17
  31. 2018Adversarial Framing for Image and Video Classificationcited by 15
  32. 2018Solid Harmonic Wavelet Scattering for Predictions of Molecule Propertiescited by 12
  33. 2018Joint Time-Frequency Scatteringcited by 11
  34. 2021VIPriors 1: Visual Inductive Priors for Data-Efficient Deep Learning Challengescited by 11
  35. 2017Understanding the Mechanisms of Deep Transfer Learning for Medical Imagescited by 10
  36. 2019A Learnable ScatterNet: Locally Invariant Convolutional Layerscited by 10
  37. 2015Joint Time-Frequency Scattering for Audio Classificationcited by 8
  38. 2016Wavelet Scattering Regression of Quantum Chemical Energiescited by 8

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 4; 2024: 1; 2025: 2; 2026: 3.

15 papers.

Sort: