mlsanityData to 14 Oct 2026

Foveated Retinotopy Improves Classification and Localization in Convolutional Neural Networks

arXiv 2402.15480 ↗First posted 23 Feb 2024cs.CV q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

From falcons spotting preys to humans recognizing faces, rapid visual abilities depend on a foveated retinal organization which delivers high-acuity central vision while preserving low-resolution periphery. This organization is conserved along early visual pathways but remains underexplored in machine learning. Here we examine how embedding a foveated retinotopic transformation as a preprocessing layer impacts convolutional neural networks (CNNs) for image classification. By applying a log-polar mapping to off-the-shelf models and retraining them, we retain comparable accuracy while improving robustness to scale and rotation. We show that this architecture becomes highly sensitive to fixation-point shifts, and that this sensitivity yields a proxy for defining saliency maps that effectively facilitates object localization. Our results show that foveated retinotopy encodes prior geometric knowledge, offering a solution to visual-search and enhancing both classification and localization. These findings connect biological vision principles with artificial networks, pointing to new, robust and efficient directions for computer-vision systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 67 references that are in the map. First posted on arXiv 23 Feb 2024.

Builds on

19 of 67 references.

References · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  5. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  6. 2013Intriguing properties of neural networkscited by 5,155
  7. 2015Spatial Transformer Networkscited by 1,429
  8. 2017Deep Image Priorcited by 1,098
  9. 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 582
  10. 2017Adversarial Attacks on Neural Network Policiescited by 320
  11. 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 248
  12. 2021AP-10K: A Benchmark for Animal Pose Estimation in the Wildcited by 123
7 more
  1. 2015Towards Biologically Plausible Deep Learningcited by 66
  2. 2023Opti-CAM: Optimizing saliency maps for interpretabilitycited by 25
  3. 2020CyCNN: A Rotation Invariant CNN using Polar Mapping and Cylindrical Convolution Layerscited by 15
  4. 2023End-to-end topographic networks as models of cortical map formation and human visual behaviour: moving beyond convolutionscited by 8
  5. 2019Human eye inspired log-polar pre-processing for neural networkscited by 2
  6. 2022Ultrafast Image Categorization in Biology and Neural Modelscited by 1
  7. 2022Learning Robust Kernel Ensembles with Kernel Average Poolingcited by 1

Built on by

Not cited yet.