mlsanityData to 14 Oct 2026

Robust Explanatory Analysis for Structured Optimization Networks (REASON) in Learning

arXiv 2610.19378 ↗First posted 14 Oct 2026cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We seek a hierarchical resolution of residual error under a composite learning objective as a principled mechanism for identifying and exploiting additional information, particularly under distribution shift and perturbation. Inspired by the System 1/System 2 paradigm, we formulate this principle as a two-loop mechanism serving a common inference goal. A fast, System 1-like loop resolves the residual addressable by the available evidence; the remaining epistemic residual triggers a medium speed, System 2-like loop that actively acquires additional evidence and measures its informational value through residual reduction. Over nested solution spaces, the medium-loop optimum is provably no worse than the fast-loop optimum. Experiments show that the resulting two-loop model consistently improves upon the fast loop at approximately half the computation of the medium loop, including under unseen corruptions, and, when provided a cleaner observation, outperforms staged classifiers and learning-to-defer methods at equal computational cost.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

21 of 32 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2017On Calibration of Modern Neural Networkscited by 4,960
  5. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
  6. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  7. 2019Searching for MobileNetV3cited by 1,994
  8. 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
  9. 2020In Search of Lost Domain Generalizationcited by 1,054
  10. 2017Selective Classification for Deep Neural Networkscited by 852
  11. 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 596
  12. 2018Do Better ImageNet Models Transfer Better?cited by 565
9 more
  1. 2019Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Comingcited by 336
  2. 2020Consistent Estimators for Learning to Defer to an Expertcited by 271
  3. 2017Adaptive Neural Networks for Efficient Inferencecited by 163
  4. 2017The Consciousness Priorcited by 107
  5. 2023When Does Confidence-Based Cascade Deferral Suffice?cited by 60
  6. 2022A Call to Reflect on Evaluation Practices for Failure Detection in Image Classificationcited by 52
  7. 2024Which Backbone to Use: A Resource-efficient Domain Specific Comparison for Computer Visioncited by 6
  8. 2024Koopcon: A new approach towards smarter and less complex learningcited by 3
  9. 2024Generative Expansion of Small Datasets: An Expansive Graph Approachcited by 2

Built on by

Not cited yet.