mlsanityData to 14 Oct 2026

Stochastic Pooling for Regularization of Deep Convolutional Neural Networks

arXiv 1301.3557 ↗First posted 16 Jan 2013cs.LG cs.NE stat.MLcited by 48

Not on the map. Why?

Abstract (arXiv)

We introduce a simple and effective method for regularizing large convolutional neural networks. We replace the conventional deterministic pooling operations with a stochastic procedure, randomly picking the activation within each pooling region according to a multinomial distribution, given by the activities within the pooling region. The approach is hyper-parameter free and can be combined with other regularization approaches, such as dropout and data augmentation. We achieve state-of-the-art performance on four image datasets, relative to other approaches that do not utilize data augmentation.

Key facts. Cited by 48 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Jan 2013.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 12; 2022: 11; 2023: 8; 2024: 7; 2025: 5; 2026: 5.

48 papers.

Sort:

By area:

  1. 2024SOFTS: Efficient Multivariate Time Series Forecasting with Series-Core Fusioncited by 76
  2. 2021AdaPool: Exponential Adaptive Pooling for Information-Retaining Downsamplingcited by 47
  3. 2021WaveCNet: Wavelet Integrated CNNs to Suppress Aliasing Effect for Noise-Robust Image Classificationcited by 29
  4. 2021Refining activation downsampling with SoftPoolcited by 26
  5. 2021Resolution learning in deep convolutional networks using scale-space theorycited by 26
  6. 2022Temporal Lift Pooling for Continuous Sign Language Recognitioncited by 26
  7. 2023A Comprehensive Overview and Comparative Analysis on Deep Learning Models: CNN, RNN, LSTM, GRUcited by 25
  8. 2021Data Augmentation in Natural Language Processing: A Novel Text Generation Approach for Long and Short Text Classifierscited by 24
  9. 2023On the Over-Memorization During Natural, Robust and Catastrophic Overfittingcited by 20
  10. 2022Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networkscited by 18
  11. 2022Genie: Show Me the Data for Quantizationcited by 17
  12. 2021LiftPool: Bidirectional ConvNet Poolingcited by 11
36 more
  1. 2023Online Continual Learning for Robust Indoor Object Recognitioncited by 9
  2. 2023Online Continual Learning in Keyword Spotting for Low-Resource Devices via Pooling High-Order Temporal Statisticscited by 9
  3. 2021Differentially Private Bayesian Neural Networks on Accuracy, Privacy and Reliabilitycited by 6
  4. 2023A General Framework for Robust G-Invariance in G-Equivariant Networkscited by 5
  5. 2022Block shuffling learning for Deepfake Detectioncited by 4
  6. 2021Learnable Discrete Wavelet Pooling (LDW-Pooling) For Convolutional Networkscited by 3
  7. 2022Canonical convolutional neural networkscited by 3
  8. 2024KeepOriginalAugment: Single Image-based Better Information-Preserving Data Augmentation Approachcited by 3
  9. 2022Fuzzy Poolingcited by 2
  10. 2022Data Dimension Reduction makes ML Algorithms efficientcited by 2
  11. 2024NOAH: Learning Pairwise Object Category Attentions for Image Classificationcited by 2
  12. 2024Spectral U-Net: Enhancing Medical Image Segmentation via Spectral Decompositioncited by 2
  13. 2021Maximal function pooling with applicationscited by 1
  14. 2022Neuron-Specific Dropout: A Deterministic Regularization Technique to Prevent Neural Networks from Overfitting & Reduce Dependence on Large Training Samplescited by 1
  15. 2022Stochastic Perturbations of Tabular Features for Non-Deterministic Inference with Automungecited by 1
  16. 2022An application of Pixel Interval Down-sampling (PID) for dense tiny microorganism counting on environmental microorganism imagescited by 1
  17. 2024Deep Nets with Subsampling Layers Unwittingly Discard Useful Activations at Test-Timecited by 1
  18. 2025AMD-HookNet++: Evolution of AMD-HookNet with Hybrid CNN-Transformer Feature Enhancement for Glacier Calving Front Segmentationcited by 1
  19. 2026SEER: Transformer-based Robust Time Series Forecasting via Automated Patch Enhancement and Replacementcited by 1
  20. 2021A fusion method for multi-valued datacited by 0
  21. 2021Internet of quantum blockchains: security modeling and dynamic resource pricing for stable digital currencycited by 0
  22. 2021Ordinal Poolingcited by 0
  23. 2022Effectiveness of the Recent Advances in Capsule Networkscited by 0
  24. 2023Deep Residual Compensation Convolutional Network without Backpropagationcited by 0
  25. 2023MultiScale Probability Map guided Index Pooling with Attention-based learning for Road and Building Segmentationcited by 0
  26. 2023The Road to On-board Change Detection: A Lightweight Patch-Level Change Detection Network via Exploring the Potential of Pruning and Poolingcited by 0
  27. 2024Dual-View Pyramid Pooling in Deep Neural Networks for Improved Medical Image Classification and Confidence Calibrationcited by 0
  28. 2024Stochastic Subsampling With Average Poolingcited by 0
  29. 20253DPyranet Features Fusion for Spatio-temporal Feature Learningcited by 0
  30. 2025Mitigating Context Bias in Domain Adaptation for Object Detection using Mask Poolingcited by 0
  31. 2025Relevance-driven Input Dropout: an Explanation-guided Regularization Techniquecited by 0
  32. 2025OS-HGAdapter: Open Semantic Hypergraph Adapter for Large Language Models Assisted Entropy-Enhanced Image-Text Alignmentcited by 0
  33. 2026Accurate Shift Invariant Convolutional Neural Networks Using Gaussian-Hermite Momentscited by 0
  34. 2026Blind Recovery of Latent Domains via Unsupervised Symmetry Discoverycited by 0
  35. 2026Dropout and Random Gradient Masking Are Asymptotically Equivalent in Large ResNetscited by 0
  36. 2026CARNet Cycle-Conditioned Core Aggregation and Redistribution for Multivariate Time Series Forecastingcited by 0