Amplified Patch-Level Differential Privacy for Free via Random Cropping
Not on the map. Why?
Abstract (arXiv)
Random cropping is one of the most common data augmentation techniques in computer vision, yet the role of its inherent randomness in training differentially private machine learning models has thus far gone unexplored. We observe that when sensitive content in an image is spatially localized, such as a face or license plate, random cropping can probabilistically exclude that content from the model's input. This introduces a third source of stochasticity in differentially private training with stochastic gradient descent, in addition to gradient noise and minibatch sampling. This additional randomness amplifies differential privacy without requiring changes to model architecture or training procedure. We formalize this effect by introducing a patch-level neighboring relation for vision data and deriving tight privacy bounds for differentially private stochastic gradient descent (DP-SGD) when combined with random cropping. Our analysis quantifies the patch inclusion probability and shows how it composes with minibatch sampling to yield a lower effective sampling rate. Empirically, we validate that patch-level amplification improves the privacy-utility trade-off across multiple segmentation architectures and datasets. Our results demonstrate that aligning privacy accounting with domain structure and additional existing sources of randomness can yield stronger guarantees at no additional cost.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 29 of its 53 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
29 of 53 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,991
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,435
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,216
- 2016Deep Learning with Differential Privacycited by 2,718
- 2016Pyramid Scene Parsing Networkcited by 2,474
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,273
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,159
- 2013Describing Textures in the Wildcited by 2,115
- 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 467
- 2018Privacy Amplification by Subsampling: Tight Analyses via Couplings and Divergencescited by 240
17 more
- 2020A2D2: Audi Autonomous Driving Datasetcited by 190
- 2023How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacycited by 151
- 2021Large-Scale Differentially Private BERTcited by 118
- 2021Optimal Accounting of Differential Privacy via Characteristic Functioncited by 83
- 2021Learning with User-Level Privacycited by 72
- 2017Natural and Effective Obfuscation by Head Inpaintingcited by 60
- 2022Mixed Differential Privacy in Computer Visioncited by 54
- 2022TAN Without a Burn: Scaling Laws of DP-SGDcited by 52
- 2022Connect the Dots: Tighter Discrete Approximations of Privacy Loss Distributionscited by 50
- 2016Defeating Image Obfuscation with Deep Learningcited by 43
- 2016Faceless Person Recognition; Privacy Implications in Social Mediacited by 27
- 2021DP-Image: Differential Privacy for Image Data in Feature Spacecited by 23
- 2025Scaling Laws for Differentially Private Language Modelscited by 22
- 2022Beyond Uniform Lipschitz Condition in Differentially Private Optimizationcited by 19
- 2023DP-SGD Without Clipping: The Lipschitz Neural Network Waycited by 11
- 2025Leveraging Randomness in Model and Data Partitioning for Privacy Amplificationcited by 7
- 2025Privacy Amplification by Structured Subsampling for Deep Differentially Private Time Series Forecastingcited by 3
Built on by
Not cited yet.