Learning under noisy supervision is governed by a feedback-truth gap
Not on the map. Why?
Abstract (arXiv)
When feedback is absorbed faster than task structure can be evaluated, the learner will favor feedback over truth. A two-timescale model shows this feedback-truth gap is inevitable whenever the two rates differ and vanishes only when they match. We test this prediction across neural networks trained with noisy labels (30 datasets, 2,700 runs), human probabilistic reversal learning (N = 292), and human reward/punishment learning with concurrent EEG (N = 25). In each system, truth is defined operationally: held-out labels, the objectively correct option, or the participant's pre-feedback expectation - the only non-circular reference decodable from post-feedback EEG. The gap appeared universally but was regulated differently: dense networks accumulated it as memorization; sparse-residual scaffolding suppressed it; humans generated transient over-commitment that was actively recovered. Neural over-commitment (~0.04-0.10) was amplified tenfold into behavioral commitment (d = 3.3-3.9). The gap is a fundamental constraint on learning under noisy supervision; its consequences depend on the regulation each system employs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 51 references that are in the map. First posted on arXiv 18 Feb 2026.
Builds on
10 of 51 references.
References · 10
- 2016Understanding deep learning requires rethinking generalizationcited by 1,657
- 2017A Closer Look at Memorization in Deep Networkscited by 936
- 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 919
- 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 669
- 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 663
- 2017Exploring Generalization in Deep Learningcited by 595
- 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 580
- 2020What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimationcited by 492
- 2018A mathematical theory of semantic development in deep neural networkscited by 182
- 2016Towards an integration of deep learning and neurosciencecited by 77
Built on by
Not cited yet.