Fractional Max-Pooling
Not on the map. Why?
Abstract (arXiv)
Convolutional networks almost always incorporate some form of spatial pooling, and very often it is alpha times alpha max-pooling with alpha=2. Max-pooling act on the hidden layers of the network, reducing their size by an integer multiplicative factor alpha. The amazing by-product of discarding 75% of your data is that you build into the network a degree of invariance with respect to translations and elastic distortions. However, if you simply alternate convolutional layers with max-pooling layers, performance is limited due to the rapid reduction in spatial size, and the disjoint nature of the pooling regions. We have formulated a fractional version of max-pooling where alpha is allowed to take non-integer values. Our version of max-pooling is stochastic as there are lots of different ways of constructing suitable pooling regions. We find that our form of fractional max-pooling reduces overfitting on a variety of datasets: for instance, we improve on the state-of-the art for CIFAR-100 without even using dropout.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Dec 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 11; 2023: 4; 2024: 2; 2025: 2; 2026: 3.
35 papers.
Sort:
By area:
- 2021Resolution learning in deep convolutional networks using scale-space theorycited by 26
- 2022Learning strides in convolutional neural networkscited by 25
- 2022A Survey of Automated Data Augmentation Algorithms for Deep Learning-based Image Classification Taskscited by 12
- 2021LocalDrop: A Hybrid Regularization for Deep Neural Networkscited by 8
- 2022Survey: Exploiting Data Redundancy for Optimization of Deep Learningcited by 6
- 2023A General Framework for Robust G-Invariance in G-Equivariant Networkscited by 5
- 2021Meta-learning of Pooling Layers for Character Recognitioncited by 3
- 2021Strengthening the Training of Convolutional Neural Networks By Using Walsh Matrixcited by 3
- 2021A Layer-wise Adversarial-aware Quantization Optimization for Improving Robustnesscited by 3
- 2022Comparison Analysis of Traditional Machine Learning and Deep Learning Techniques for Data and Image Classificationcited by 3
- 2022Will there be a construction? Predicting road constructions based on heterogeneous spatiotemporal datacited by 3
- 2021LogAvgExp Provides a Principled and Performant Global Pooling Operatorcited by 2
23 more
- 2022Fuzzy Poolingcited by 2
- 2023FedAVO: Improving Communication Efficiency in Federated Learning with African Vultures Optimizercited by 2
- 2026Rethinking Token Reduction for Large Vision-Language Modelscited by 2
- 2021Maximal function pooling with applicationscited by 1
- 2021DNN Quantization with Attentioncited by 1
- 2021Frequency Pooling: Shift-Equivalent and Anti-Aliasing Downsamplingcited by 1
- 2022An application of Pixel Interval Down-sampling (PID) for dense tiny microorganism counting on environmental microorganism imagescited by 1
- 2022Differentiable Self-Adaptive Learning Ratecited by 1
- 2021A Structurally Regularized Convolutional Neural Network for Image Classification using Wavelet-based SubBand Decompositioncited by 0
- 2021Deep Learning Based Analysis of Prostate Cancer from MP-MRIcited by 0
- 2021Ordinal Poolingcited by 0
- 2021Unsupervised MKL in Multi-layer Kernel Machinescited by 0
- 2022Dilated Continuous Random Field for Semantic Segmentationcited by 0
- 2022Fully Convolutional Fractional Scalingcited by 0
- 2022Deep Multi-Branch CNN Architecture for Early Alzheimer's Detection from Brain MRIscited by 0
- 2023Scale-Space Hypernetworks for Efficient Biomedical Imagingcited by 0
- 2023ADASR: An Adversarial Auto-Augmentation Framework for Hyperspectral and Multispectral Data Fusioncited by 0
- 2024Dual-View Pyramid Pooling in Deep Neural Networks for Improved Medical Image Classification and Confidence Calibrationcited by 0
- 2024Seam Carving as Feature Pooling in CNNcited by 0
- 20253DPyranet Features Fusion for Spatio-temporal Feature Learningcited by 0
- 2025Automatic Extraction of Road Networks by using Teacher-Student Adaptive Structural Deep Belief Network and Its Application to Landslide Disastercited by 0
- 2026One RNG to Rule Them All: How Randomness Becomes an Attack Vector in Machine Learningcited by 0
- 2026Mitigating Shortcut Learning: Texture-Penalized Prototype Networkscited by 0
- 2026Mitigating Shortcut Learning: Texture-Penalized Prototype Networks7 Sep 2026
- 2026Rethinking Token Reduction for Large Vision-Language Models23 Mar 2026
- 2026One RNG to Rule Them All: How Randomness Becomes an Attack Vector in Machine Learning9 Feb 2026
- 2025Automatic Extraction of Road Networks by using Teacher-Student Adaptive Structural Deep Belief Network and Its Application to Landslide Disaster4 Nov 2025
- 20253DPyranet Features Fusion for Spatio-temporal Feature Learning26 Apr 2025
- 2024Seam Carving as Feature Pooling in CNN10 Sep 2024
- 2024Dual-View Pyramid Pooling in Deep Neural Networks for Improved Medical Image Classification and Confidence Calibration6 Aug 2024
- 2023A General Framework for Robust G-Invariance in G-Equivariant Networks28 Oct 2023
- 2023ADASR: An Adversarial Auto-Augmentation Framework for Hyperspectral and Multispectral Data Fusion11 Oct 2023
- 2023FedAVO: Improving Communication Efficiency in Federated Learning with African Vultures Optimizer2 May 2023
- 2023Scale-Space Hypernetworks for Efficient Biomedical Imaging11 Apr 2023
- 2022Deep Multi-Branch CNN Architecture for Early Alzheimer's Detection from Brain MRIs22 Oct 2022
23 more
- 2022Differentiable Self-Adaptive Learning Rate19 Oct 2022
- 2022Will there be a construction? Predicting road constructions based on heterogeneous spatiotemporal data14 Sep 2022
- 2022Survey: Exploiting Data Redundancy for Optimization of Deep Learning29 Aug 2022
- 2022A Survey of Automated Data Augmentation Algorithms for Deep Learning-based Image Classification Tasks14 Jun 2022
- 2022Comparison Analysis of Traditional Machine Learning and Deep Learning Techniques for Data and Image Classification11 Apr 2022
- 2022An application of Pixel Interval Down-sampling (PID) for dense tiny microorganism counting on environmental microorganism images4 Apr 2022
- 2022Fully Convolutional Fractional Scaling20 Mar 2022
- 2022Fuzzy Pooling12 Feb 2022
- 2022Learning strides in convolutional neural networks3 Feb 2022
- 2022Dilated Continuous Random Field for Semantic Segmentation1 Feb 2022
- 2021Unsupervised MKL in Multi-layer Kernel Machines26 Nov 2021
- 2021LogAvgExp Provides a Principled and Performant Global Pooling Operator2 Nov 2021
- 2021A Layer-wise Adversarial-aware Quantization Optimization for Improving Robustness23 Oct 2021
- 2021Frequency Pooling: Shift-Equivalent and Anti-Aliasing Downsampling24 Sep 2021
- 2021Ordinal Pooling3 Sep 2021
- 2021Resolution learning in deep convolutional networks using scale-space theory7 Jun 2021
- 2021Deep Learning Based Analysis of Prostate Cancer from MP-MRI2 Jun 2021
- 2021Strengthening the Training of Convolutional Neural Networks By Using Walsh Matrix31 Mar 2021
- 2021DNN Quantization with Attention24 Mar 2021
- 2021Meta-learning of Pooling Layers for Character Recognition17 Mar 2021
- 2021A Structurally Regularized Convolutional Neural Network for Image Classification using Wavelet-based SubBand Decomposition2 Mar 2021
- 2021Maximal function pooling with applications1 Mar 2021
- 2021LocalDrop: A Hybrid Regularization for Deep Neural Networks1 Mar 2021
- 2026Rethinking Token Reduction for Large Vision-Language Models23 Mar 2026
- 2021Resolution learning in deep convolutional networks using scale-space theorycited by 26
- 2022Learning strides in convolutional neural networkscited by 25
- 2022A Survey of Automated Data Augmentation Algorithms for Deep Learning-based Image Classification Taskscited by 12
- 2021LocalDrop: A Hybrid Regularization for Deep Neural Networkscited by 8
- 2022Survey: Exploiting Data Redundancy for Optimization of Deep Learningcited by 6
- 2023A General Framework for Robust G-Invariance in G-Equivariant Networkscited by 5
- 2021Meta-learning of Pooling Layers for Character Recognitioncited by 3
- 2021Strengthening the Training of Convolutional Neural Networks By Using Walsh Matrixcited by 3
- 2021A Layer-wise Adversarial-aware Quantization Optimization for Improving Robustnesscited by 3
- 2022Comparison Analysis of Traditional Machine Learning and Deep Learning Techniques for Data and Image Classificationcited by 3
- 2022Will there be a construction? Predicting road constructions based on heterogeneous spatiotemporal datacited by 3
- 2021LogAvgExp Provides a Principled and Performant Global Pooling Operatorcited by 2
12 most cited of 34 All 34 (JSON)
- 2026Mitigating Shortcut Learning: Texture-Penalized Prototype Networks7 Sep 2026
- 2026One RNG to Rule Them All: How Randomness Becomes an Attack Vector in Machine Learning9 Feb 2026
- 2025Automatic Extraction of Road Networks by using Teacher-Student Adaptive Structural Deep Belief Network and Its Application to Landslide Disaster4 Nov 2025
- 20253DPyranet Features Fusion for Spatio-temporal Feature Learning26 Apr 2025
- 2024Seam Carving as Feature Pooling in CNN10 Sep 2024
- 2024Dual-View Pyramid Pooling in Deep Neural Networks for Improved Medical Image Classification and Confidence Calibration6 Aug 2024
- 2023A General Framework for Robust G-Invariance in G-Equivariant Networks28 Oct 2023
- 2023ADASR: An Adversarial Auto-Augmentation Framework for Hyperspectral and Multispectral Data Fusion11 Oct 2023
- 2023FedAVO: Improving Communication Efficiency in Federated Learning with African Vultures Optimizer2 May 2023
- 2023Scale-Space Hypernetworks for Efficient Biomedical Imaging11 Apr 2023
- 2022Deep Multi-Branch CNN Architecture for Early Alzheimer's Detection from Brain MRIs22 Oct 2022
- 2022Differentiable Self-Adaptive Learning Rate19 Oct 2022
12 newest of 34 All 34 (JSON)