mlsanityData to 14 Oct 2026

Decoupling Is Not Identification: Supervised Evidential Learning in Next-Token Prediction

arXiv 2609.26268 ↗First posted 14 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

A next-token probability says what a model predicts, not how much training support lies behind it. A Dirichlet head can represent this distinction by separating mean m from concentration S, but decoupling does not identify what S means. Here we propose an Evidential Next-Token Prediction (ENTOP) framework to audit this gap on character-level Moby-Dick, using exact 8-gram count as a reproducible lexical-support label and withholding count regression from 20% of context types. Standard implicit evidential training carries essentially no count signal beyond confidence on held-out-label types (partial Spearman ρ = 0.001 ± 0.014), whereas explicit supervision generalizes (ρ = 0.201 ± 0.010; matched-pair win = 0.822 ± 0.021). CE predictive entropy is at chance for unseen 8-grams (AUROC = 0.490 ± 0.004), while supervised vacuity reaches 0.772 ± 0.003, comparable with an indexed CE-representation baseline (0.769) but below the tautological corpus oracle (1.000). Neither longest-suffix nor representation-distance strata explain where amortization succeeds. Increasing count weight under the digamma objective improves support fit only by sacrificing prediction. A constant predictor wins natural log-RMSE, and vacuity does not improve error deferral. These results motivate a minimum evidence protocol---confidence control, matched pairs, held-out labels, a constant baseline, and a decision test---and show that concentration can pass identification while failing calibration and utility.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 9 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

7 of 9 references.

References · 7

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 732
  3. 2018Predictive Uncertainty Estimation via Prior Networkscited by 557
  4. 2019Deep Evidential Regressioncited by 355
  5. 2020Posterior Network: Uncertainty Estimation without OOD Samples via Density-Based Pseudo-Countscited by 164
  6. 2021Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimationcited by 71
  7. 2022Pitfalls of Epistemic Uncertainty Quantification through Loss Minimisationcited by 66

Built on by

Not cited yet.