# Detecting Explanatory Insufficiency in Learned Representations: A Framework for Representational Vigilance

arXiv: https://arxiv.org/abs/2606.13172 · HTML: https://mlsanity.com/paper/2606.13172/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 12 of its 32 references that are in the map.
- First posted on arXiv 11 Jun 2026.

## Builds on (most cited first, 12 of 12)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [Language Models are Few-Shot Learners](https://mlsanity.com/paper/2005.14165/) (2020)
- [On Calibration of Modern Neural Networks](https://mlsanity.com/paper/1706.04599/) (2017)
- [Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning](https://mlsanity.com/paper/1506.02142/) (2015)
- [On the Opportunities and Risks of Foundation Models](https://mlsanity.com/paper/2108.07258/) (2021)
- [A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks](https://mlsanity.com/paper/1610.02136/) (2016)
- [What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?](https://mlsanity.com/paper/1703.04977/) (2017)
- [World Models](https://mlsanity.com/paper/1803.10122/) (2018)
- [Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift](https://mlsanity.com/paper/1906.02530/) (2019)
- [Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methods](https://mlsanity.com/paper/1910.09457/) (2019)
- [Scientific Inference With Interpretable Machine Learning: Analyzing Models to Learn About Real-World Phenomena](https://mlsanity.com/paper/2206.05487/) (2022)

## Abstract (arXiv)

Learned representations are commonly evaluated through predictive performance, calibration, robustness, uncertainty estimation, and behavior under distribution shift. Yet these criteria do not determine whether the representation itself remains sufficient for organizing observations relevant to an explanatory task. We develop VER (Vigilance Explicative et Representationnelle; explanatory and representational vigilance) around a narrower question: can a system detect when its current representation becomes explanatorily insufficient without confusing insufficiency with ordinary error, missing data, uncertainty, or distribution shift? The current VER framework follows seven stages: TRACE, EVIDENCE, INSUFFICIENCY, REGIME HYPOTHESES, TRANSITION ASSESSMENT, VIGILANCE, and PROBE. It treats structured residuals as signals rather than verdicts, distinguishes data insufficiency from representation insufficiency, preserves multiple hypotheses under non-identifiability, allows a legitimate NON-DETERMINED outcome, and requires a discriminating Probe before stronger conclusions are drawn. It also separates variation, drift, adaptation, and representational transition, and introduces Present Enrichment before attributing explanatory value to history. Two paired thought experiments and a falsifiable benchmark are proposed. VER is not claimed to be empirically validated here; its contribution is an explicit architecture designed for auditability and for selecting observations that discriminate among competing explanations.