mlsanityData to 14 Oct 2026

Evaluation Resolution Confounds Learning-Rule Comparisons in Model-Brain RSA of Early Visual Cortex

arXiv 2608.12408 ↗First posted 11 Aug 2026q-bio.NC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Studies of biologically plausible learning rules (feedback alignment, predictive coding, STDP) train small networks on 32×32 images and compare them with brain responses to naturalistic stimuli presented at much higher resolution. We find that a common result in this setting, that untrained or locally trained networks rival or beat backpropagation at early visual cortex, depends on the resolution at which networks are evaluated. In representational similarity analysis (RSA) against human V1, the gap between an untrained and a backprop-trained network grows monotonically from -0.001 (95% CI [-0.011, 0.009]) at the 32 px training resolution to +0.030 [0.018, 0.042] at 224 px (six resolutions, 5 seeds; per-subject RSA on cross-run stimulus pairs). The growth reproduces for three further learning rules, directionally in single-seed macaque electrophysiology, along training, and for an ImageNet ResNet-50 and a Swin-Tiny transformer, which also align best at low resolution although trained at 224 px. Gabor and pixel structure, the normalization state of the untrained baseline, and a global brightness statistic do not account for it. Against a criterion fixed before the analysis, limiting image content to 32 px while the input still grows does not shrink the V1 gap (+0.035 [0.023, 0.046] vs. +0.030 at 224 px; ratio 1.14 [1.03, 1.34]): it arises once the input exceeds the training resolution, through a decline of backprop. A single luminance value per image reaches ρ = 0.054 against V1, matching the untrained network (0.053), which bounds what RSA on globally pooled features can resolve at V1 in this dataset. The one learning effect that holds across resolution is backprop above untrained at LOC. Comparisons of learning rules or architectures at early visual cortex need to control, and report, the evaluation resolution.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 20 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

4 of 20 references.

References · 4

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2018Correspondence of Deep Neural Networks and the Brain for Visual Texturescited by 3
  4. 2026Untrained CNNs Exceed Backpropagation in V1 Alignment at High Evaluation Resolution: A Systematic RSA Comparison of Four Learning Rules Against Human fMRIcited by 3

Built on by

Not cited yet.