Mind the Pad -- CNNs can Develop Blind Spots
Not on the map. Why?
Abstract (arXiv)
We show how feature maps in convolutional networks are susceptible to spatial bias. Due to a combination of architectural choices, the activation at certain locations is systematically elevated or weakened. The major source of this bias is the padding mechanism. Depending on several aspects of convolution arithmetic, this mechanism can apply the padding unevenly, leading to asymmetries in the learned weights. We demonstrate how such bias can be detrimental to certain tasks such as small object detection: the activation is suppressed if the stimulus lies in the impacted area, leading to blind spots and misdetection. We propose solutions to mitigate spatial bias and demonstrate how they can improve model accuracy.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 15; 2023: 8; 2024: 1; 2025: 3; 2026: 2.
41 papers.
Sort:
By area:
- 2022Simple Baselines for Image Restorationcited by 701
- 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
- 2022Feature-Realistic Neural Fusion for Real-Time, Open Set Scene Understandingcited by 37
- 2022Stabilizing Off-Policy Deep Reinforcement Learning from Pixelscited by 32
- 2023Deep Image Fingerprint: Towards Low Budget Synthetic Image Detection and Model Lineage Analysiscited by 29
- 2021Position, Padding and Predictions: A Deeper Look at Position Information in CNNscited by 26
- 2021FoveaTer: Foveated Transformer for Image Classificationcited by 26
- 2022High-fidelity GAN Inversion with Padding Spacecited by 23
- 2021GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generationcited by 19
- 2021Toward Spatially Unbiased Generative Modelscited by 17
- 2021Shift Invariance Can Reduce Adversarial Robustnesscited by 16
- 2021Effects of boundary conditions in fully convolutional networks for learning spatio-temporal dynamicscited by 14
29 more
- 2022Classification of Long Sequential Data using Circular Dilated Convolutional Neural Networkscited by 13
- 2021Global Pooling, More than Meets the Eye: Position Information is Encoded Channel-Wise in CNNscited by 12
- 2022Cylin-Painting: Seamless 360textdegree Panoramic Image Outpainting and Beyondcited by 12
- 2022Finding Biological Plausibility for Adversarially Robust Features via Metameric Taskscited by 11
- 2023RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learningcited by 8
- 2025Foundation Models and Transformers for Anomaly Detection: A Surveycited by 8
- 2021How Shift Equivariance Impacts Metric Learning for Instance Segmentationcited by 7
- 2022Prescriptive and Descriptive Approaches to Machine-Learning Transparencycited by 7
- 2023Zone Evaluation: Revealing Spatial Bias in Object Detectioncited by 7
- 2023Hierarchical Disentanglement-Alignment Network for Robust SAR Vehicle Recognitioncited by 6
- 2021NeRD: Neural Representation of Distribution for Medical Image Segmentationcited by 5
- 2021LatentKeypointGAN: Controlling Images via Latent Keypointscited by 5
- 2022Unveiling The Mask of Position-Information Pattern Through the Mist of Image Featurescited by 3
- 2022Generalization to translation shifts: a study in architectures and augmentationscited by 3
- 2021Improved Padding in CNNs for Quantitative Susceptibility Mappingcited by 2
- 2021Seamless Satellite-image Synthesiscited by 2
- 2026Auditing Sybil: Explaining Deep Lung Cancer Risk Prediction Through Generative Interventional Attributionscited by 2
- 2026AdaSpot: Spend Resolution Where It Matters for Precise Event Spottingcited by 2
- 2022Super-Resolution Based Patch-Free 3D Image Segmentation with High-Frequency Guidancecited by 1
- 2023On the Interplay of Convolutional Padding and Adversarial Robustnesscited by 1
- 2023Padding-free Convolution based on Preservation of Differential Characteristics of Kernelscited by 1
- 2025On Symmetries in Convolutional Weightscited by 1
- 2022Exoplanet Cartography using Convolutional Neural Networkscited by 0
- 2022LatentKeypointGAN: Controlling Images via Latent Keypoints -- Extended Abstractcited by 0
- 2022Shift Variance in Scene Text Detectioncited by 0
- 2023Improving Translation Invariance in Convolutional Neural Networks with Peripheral Prediction Paddingcited by 0
- 2023Padding Aware Neuronscited by 0
- 2024Certified ML Object Detection for Surveillance Missionscited by 0
- 2025A Systematic Reproducibility Study of BSARec for Sequential Recommendationcited by 0
- 2026AdaSpot: Spend Resolution Where It Matters for Precise Event Spotting25 Feb 2026
- 2026Auditing Sybil: Explaining Deep Lung Cancer Risk Prediction Through Generative Interventional Attributions30 Jan 2026
- 2025A Systematic Reproducibility Study of BSARec for Sequential Recommendation19 Dec 2025
- 2025Foundation Models and Transformers for Anomaly Detection: A Survey21 Jul 2025
- 2025On Symmetries in Convolutional Weights24 Mar 2025
- 2024Certified ML Object Detection for Surveillance Missions18 Jun 2024
- 2023Zone Evaluation: Revealing Spatial Bias in Object Detection20 Oct 2023
- 2023Padding Aware Neurons14 Sep 2023
- 2023Padding-free Convolution based on Preservation of Differential Characteristics of Kernels12 Sep 2023
- 2023On the Interplay of Convolutional Padding and Adversarial Robustness12 Aug 2023
- 2023Improving Translation Invariance in Convolutional Neural Networks with Peripheral Prediction Padding15 Jul 2023
- 2023Hierarchical Disentanglement-Alignment Network for Robust SAR Vehicle Recognition7 Apr 2023
29 more
- 2023Deep Image Fingerprint: Towards Low Budget Synthetic Image Detection and Model Lineage Analysis19 Mar 2023
- 2023RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning4 Jan 2023
- 2022Super-Resolution Based Patch-Free 3D Image Segmentation with High-Frequency Guidance26 Oct 2022
- 2022Feature-Realistic Neural Fusion for Real-Time, Open Set Scene Understanding6 Oct 2022
- 2022Shift Variance in Scene Text Detection19 Aug 2022
- 2022Generalization to translation shifts: a study in architectures and augmentations5 Jul 2022
- 2022Stabilizing Off-Policy Deep Reinforcement Learning from Pixels3 Jul 2022
- 2022Unveiling The Mask of Position-Information Pattern Through the Mist of Image Features2 Jun 2022
- 2022LatentKeypointGAN: Controlling Images via Latent Keypoints -- Extended Abstract6 May 2022
- 2022Prescriptive and Descriptive Approaches to Machine-Learning Transparency27 Apr 2022
- 2022Exoplanet Cartography using Convolutional Neural Networks25 Apr 2022
- 2022Cylin-Painting: Seamless 360textdegree Panoramic Image Outpainting and Beyond18 Apr 2022
- 2022Simple Baselines for Image Restoration10 Apr 2022
- 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer7 Apr 2022
- 2022High-fidelity GAN Inversion with Padding Space21 Mar 2022
- 2022Finding Biological Plausibility for Adversarially Robust Features via Metameric Tasks2 Feb 2022
- 2022Classification of Long Sequential Data using Circular Dilated Convolutional Neural Networks6 Jan 2022
- 2021GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generation2 Dec 2021
- 2021Seamless Satellite-image Synthesis5 Nov 2021
- 2021Global Pooling, More than Meets the Eye: Position Information is Encoded Channel-Wise in CNNs17 Aug 2021
- 2021Toward Spatially Unbiased Generative Models3 Aug 2021
- 2021Improved Padding in CNNs for Quantitative Susceptibility Mapping21 Jun 2021
- 2021Effects of boundary conditions in fully convolutional networks for learning spatio-temporal dynamics21 Jun 2021
- 2021FoveaTer: Foveated Transformer for Image Classification29 May 2021
- 2021LatentKeypointGAN: Controlling Images via Latent Keypoints29 Mar 2021
- 2021NeRD: Neural Representation of Distribution for Medical Image Segmentation6 Mar 2021
- 2021Shift Invariance Can Reduce Adversarial Robustness3 Mar 2021
- 2021Position, Padding and Predictions: A Deeper Look at Position Information in CNNs28 Jan 2021
- 2021How Shift Equivariance Impacts Metric Learning for Instance Segmentation14 Jan 2021
- 2022Simple Baselines for Image Restorationcited by 701
- 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
- 2022Feature-Realistic Neural Fusion for Real-Time, Open Set Scene Understandingcited by 37
- 2022Stabilizing Off-Policy Deep Reinforcement Learning from Pixelscited by 32
- 2021Position, Padding and Predictions: A Deeper Look at Position Information in CNNscited by 26
- 2021FoveaTer: Foveated Transformer for Image Classificationcited by 26
- 2022High-fidelity GAN Inversion with Padding Spacecited by 23
- 2021GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generationcited by 19
- 2021Toward Spatially Unbiased Generative Modelscited by 17
- 2021Shift Invariance Can Reduce Adversarial Robustnesscited by 16
- 2021Effects of boundary conditions in fully convolutional networks for learning spatio-temporal dynamicscited by 14
- 2022Classification of Long Sequential Data using Circular Dilated Convolutional Neural Networkscited by 13
12 most cited of 40 All 40 (JSON)
- 2026AdaSpot: Spend Resolution Where It Matters for Precise Event Spotting25 Feb 2026
- 2026Auditing Sybil: Explaining Deep Lung Cancer Risk Prediction Through Generative Interventional Attributions30 Jan 2026
- 2025A Systematic Reproducibility Study of BSARec for Sequential Recommendation19 Dec 2025
- 2025Foundation Models and Transformers for Anomaly Detection: A Survey21 Jul 2025
- 2025On Symmetries in Convolutional Weights24 Mar 2025
- 2024Certified ML Object Detection for Surveillance Missions18 Jun 2024
- 2023Zone Evaluation: Revealing Spatial Bias in Object Detection20 Oct 2023
- 2023Padding Aware Neurons14 Sep 2023
- 2023Padding-free Convolution based on Preservation of Differential Characteristics of Kernels12 Sep 2023
- 2023On the Interplay of Convolutional Padding and Adversarial Robustness12 Aug 2023
- 2023Improving Translation Invariance in Convolutional Neural Networks with Peripheral Prediction Padding15 Jul 2023
- 2023Hierarchical Disentanglement-Alignment Network for Robust SAR Vehicle Recognition7 Apr 2023
12 newest of 40 All 40 (JSON)