Why Conclusions Diverge from the Same Observations: Formalizing World-Model Non-Identifiability via an Inference
On the map: World models → World models for language agents
Abstract (arXiv)
When people share the same documents and observations yet reach different conclusions, the disagreement often shifts into a judgment that the other party is cognitively defective, irrational, or acting in bad faith. This paper argues that such divergence is better described as a form of non-identifiability inherent in inference and learning, rather than as a defect of the other party. We organize the phenomenon into two levels: (i) θ-level non-identifiability, where conclusions diverge under the same world model W because inference settings differ; and (ii) W-level non-identifiability, where repeated use of an inference setting θ biases data exposure and update rules, causing the learned world model W itself to diverge. We introduce an inference profile θ = (R, E, S, D), consisting of Reference, Exploration, Stabilization, and Horizon, and show how outputs can split even for the same observation o and the same W. We further explain why disagreements tend to project onto a small number of bases -- abstract versus concrete, externalizability, and order versus freedom -- as a consequence of general constraints on learning systems: computational, observational, and coordination constraints. Finally, we relate the framework to deep representation learning, including representation hierarchy, latent-state estimation, and regularization-exploration trade-offs, and illustrate the framework through a case study on AI regulation debates.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 3 of its 16 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
3 of 16 references.
References · 3
- 2017Attention Is All You Needcited by 59,932
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2021Demystifying the Draft EU Artificial Intelligence Actcited by 82
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Reasoning Models Are Accurate but Unsound on Identification
- 2026Reasoning Concentrates Errors, and Self-Consistency Never Notices
- 2026Auditing Pairwise Equivalence Judgments: Self-Critique Effects and Diversity Measurement in Multi-Agent Hypothesis Generation
- 2026WorldKernel: A World Model is the Coupling Kernel of Admissible Possible Worlds
- 2026The Theory of Mind Utility: A Formal Account of Mentalizing
- 2026Trust, but Don't Verify: Epistemic Blind Spots in LLM Source Evaluation
- 2026When Verification Fails: How Compositionally Infeasible Claims Escape Rejection
- 2026Human Adults and LLMs as Scientists: Who Benefits from Active Exploration?