Decoupling Is Not Identification: Supervised Evidential Learning in Next-Token Prediction
Not on the map. Why?
Abstract (arXiv)
A next-token probability says what a model predicts, not how much training support lies behind it. A Dirichlet head can represent this distinction by separating mean m from concentration S, but decoupling does not identify what S means. Here we propose an Evidential Next-Token Prediction (ENTOP) framework to audit this gap on character-level Moby-Dick, using exact 8-gram count as a reproducible lexical-support label and withholding count regression from 20% of context types. Standard implicit evidential training carries essentially no count signal beyond confidence on held-out-label types (partial Spearman ρ = 0.001 ± 0.014), whereas explicit supervision generalizes (ρ = 0.201 ± 0.010; matched-pair win = 0.822 ± 0.021). CE predictive entropy is at chance for unseen 8-grams (AUROC = 0.490 ± 0.004), while supervised vacuity reaches 0.772 ± 0.003, comparable with an indexed CE-representation baseline (0.769) but below the tautological corpus oracle (1.000). Neither longest-suffix nor representation-distance strata explain where amortization succeeds. Increasing count weight under the digamma objective improves support fit only by sacrificing prediction. A constant predictor wins natural log-RMSE, and vacuity does not improve error deferral. These results motivate a minimum evidence protocol---confidence control, matched pairs, held-out labels, a constant baseline, and a decision test---and show that concentration can pass identification while failing calibration and utility.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 9 references that are in the map. First posted on arXiv 14 Aug 2026.
Builds on
7 of 9 references.
References · 7
- 2017Attention Is All You Needcited by 60,361
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 732
- 2018Predictive Uncertainty Estimation via Prior Networkscited by 557
- 2019Deep Evidential Regressioncited by 355
- 2020Posterior Network: Uncertainty Estimation without OOD Samples via Density-Based Pseudo-Countscited by 164
- 2021Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimationcited by 71
- 2022Pitfalls of Epistemic Uncertainty Quantification through Loss Minimisationcited by 66
Built on by
Not cited yet.