mlsanityData to 14 Oct 2026

The Computational Value of Sensory-Aligned Receptive Fields Depends on Neuronal Expressivity

arXiv 2609.26940 ↗First posted 22 Sep 2026cs.NE cs.LG q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

Biological sensory neurons have selective receptive fields organized along meaningful stimulus coordinates, such as frequency, motion direction, or retinotopic position. Such structure may arise from efficient coding and biological constraints on activity, connectivity, and wiring, as computational studies of simple neurons have shown across modalities. This raises a question: do structured receptive fields confer a computational advantage beyond resource efficiency itself, and does this advantage persist when individual neurons are highly expressive? We address this question in recurrent networks of Expressive Leaky Memory neurons, where we can independently vary neuronal complexity and the organization of feed-forward receptive fields. Across auditory and event-based visual classification tasks, receptive fields aligned with a task-relevant sensory coordinate improve test accuracy relative to budget-matched random receptive fields. This advantage disappears when sensory coordinates are scrambled, or when receptive fields follow task-irrelevant coordinates, showing that the benefit comes from alignment with task geometry rather than restricted connectivity alone. Increasing neuronal complexity reduces the performance advantage of structured receptive fields. Finally, generic synaptic sparsity regularization induces input selectivity and partially recovers performance, but remains substantially below explicitly structured receptive fields, suggesting that sparsity alone is insufficient to recover the full computational benefit of task-aligned receptive fields. Together, our results show that appropriate receptive fields can serve as a computational prior beyond sparsity itself, and that their value depends on the computational expressivity of individual neurons.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

12 of 33 references.

References · 12

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
  3. 2021ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biasescited by 484
  4. 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 169
  5. 2020Towards Learning Convolutions from Scratchcited by 46
  6. 2022Disentanglement with Biological Constraints: A Theory of Functional Cell Typescited by 30
  7. 2020Revisiting Spatial Invariance with Low-Rank Local Connectivitycited by 29
  8. 2022Data-driven emergence of convolutional structure in neural networkscited by 29
  9. 2019A Unified Theory of Early Visual Representations from Retina to Cortex through Anatomically Constrained Deep CNNscited by 10
  10. 2023The Expressive Leaky Memory Neuron: an Efficient and Expressive Phenomenological Neuron Model Can Solve Long-Horizon Taskscited by 5
  11. 2024Role of Locality and Weight Sharing in Image-Based Tasks: A Sample Complexity Separation between CNNs, LCNs, and FCNscited by 5
  12. 2026Scaling Laws and Tradeoffs in Recurrent Networks of Expressive Neuronscited by 1

Built on by

Not cited yet.