mlsanityData to 13 Oct 2026

Early Cue Precision Shapes Visual Shortcut Learning in Controlled Cue-Manipulation Benchmarks

arXiv 2606.30344 ↗First posted 29 Jun 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Visual classifiers can achieve high matched-distribution accuracy while relying on low-level cues that fail under conflict or suppression. We test whether this failure is shaped by early cue precision: the reliability with which a low-level cue predicts the label during early learning or downstream probe fitting. Across synthetic shape-texture tasks, sequential digit training, a 10-class frozen-representation audit, and a CIFAR-10 natural-image-based texture-overlay benchmark, we manipulate object-texture match probability and evaluate matched-ID accuracy, conflict accuracy, texture-choice rate, and suppression behavior. Degraded-but-predictive input does not substitute for cue decorrelation. In 10-class digit probes, conflict accuracy drops from 0.589 under chance-like cue precision to 0.005 under target-perfect texture. In CIFAR-10 frozen probes, conflict accuracy drops from 0.569 to 0.114, while texture choice rises from 0.049 to 0.855; this ordering persists across texture-overlay strengths alpha in {0.15,0.25,0.35,0.50}. End-to-end CIFAR-10 training shows that low early cue precision improves pre-target conflict behavior, but shortcut-rich fine-tuning can rapidly overwrite this benefit. Cue decorrelation must therefore be maintained during downstream adaptation rather than treated as a one-time inoculation.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

12 of 22 references.

References · 12

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,111
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
  5. 2017On Calibration of Modern Neural Networkscited by 4,902
  6. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,862
  7. 2020Shortcut Learning in Deep Neural Networkscited by 1,944
  8. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
  9. 2019Natural Adversarial Examplescited by 1,405
  10. 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,242
  11. 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 953
  12. 2022Last Layer Re-Training is Sufficient for Robustness to Spurious Correlationscited by 380

Built on by

Not cited yet.