Stability of the scattering transform for deformations with minimal regularity
Not on the map. Why?
Abstract (arXiv)
Within the mathematical analysis of deep convolutional neural networks, the wavelet scattering transform introduced by St'ephane Mallat is a unique example of how the ideas of multiscale analysis can be combined with a cascade of modulus nonlinearities to build a nonexpansive, translation invariant signal representation with provable geometric stability properties, namely Lipschitz continuity to the action of small C2 diffeomorphisms - a remarkable result for both theoretical and practical purposes, inherently depending on the choice of the filters and their arrangement into a hierarchical architecture. In this note, we further investigate the intimate relationship between the scattering structure and the regularity of the deformation in the H"older regularity scale Cα, α >0. We are able to precisely identify the stability threshold, proving that stability is still achievable for deformations of class Cα, α>1, whereas instability phenomena can occur at lower regularity levels modelled by Cα, 0≤ α <1. While the behaviour at the threshold given by Lipschitz (or even C1) regularity remains beyond reach, we are able to prove a stability bound in that case, up to varepsilon losses.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 41 references that are in the map. First posted on arXiv 23 May 2022.
Builds on
13 of 41 references.
References · 13
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2016Adversarial examples in the physical worldcited by 1,762
- 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 919
- 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
- 2019Surprises in High-Dimensional Ridgeless Least Squares Interpolationcited by 508
- 2019The generalization error of random features regression: Precise asymptotics and double descent curvecited by 410
- 2015A Mathematical Theory of Deep Convolutional Neural Networks for Feature Extractioncited by 46
- 2018ADef: an Iterative Algorithm to Construct Adversarial Deformationscited by 38
- 2018On Lipschitz Bounds of General Convolutional Neural Networkscited by 29
- 2017Lipschitz Properties for Deep Convolutional Networkscited by 9
1 more
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 2.
3 papers.
- 2023Manifold Filter-Combine Networkscited by 2
- 2025InfoGain Wavelets: Furthering the Design of Graph Diffusion Waveletscited by 0
- 2025Scattering Networks on Noncommutative Finite Groupscited by 0
- 2025Scattering Networks on Noncommutative Finite Groups27 May 2025
- 2025InfoGain Wavelets: Furthering the Design of Graph Diffusion Wavelets8 Apr 2025
- 2023Manifold Filter-Combine Networks8 Jul 2023