Toward AI That Understands Self and Others: A World-Model Theory of Cognitive Diversity and Alignment
On the map: World models → World models for language agents
Abstract (arXiv)
Modern societies possess more information than ever before, yet they do not converge toward a single shared understanding. The same events, facts, laws, technologies, or risks can be interpreted as evidence of freedom, danger, exclusion, injustice, responsibility, or unrealized possibility. Existing discussions often treat such disagreement as a conflict of values, preferences, or beliefs. This paper argues that disagreement is already a late-stage phenomenon. The central premise is simple but not trivial: observation is not yet inference. Not every observation becomes inferentially relevant, and not every possible object in an observation sequence becomes an estimation target. A possible target becomes admissible only when a state representation can be constructed that is approximately sufficient for prediction, evaluation, or action with respect to that target. This paper develops a world-model theory of cognitive diversity and alignment by reconstructing recognition as the construction of such approximate sufficient statistics under finite informational, representational, observational, and action constraints. It formulates this position as the Multi-Phase Inference Assumption (MIA) and defines its core internal mechanism as the Multi-Phase Inference Mechanism (MIM). The framework introduces alignment maps and transformation loss to analyze how heterogeneous world models communicate without being collapsed into a single representation. World-model alignment is therefore processability, not agreement: the design of AI systems that help heterogeneous forms of intelligence remain mutually processable while preserving their distinct error-detection capacities.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 4 of its 101 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
4 of 101 references.
Closest ancestors · 1
Same direction, newest first
Other references · 3
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2018World Modelscited by 1,444
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Human Cognition in Machines: A Unified Perspective of World Models
- 2026Social Reasoning in Machines: Investigating Collective Truth-Seeking Dynamics in Large Language Model Debate
- 2025Towards Cognitive Synergy in LLM-Based Multi-Agent Systems: Integrating Theory of Mind and Critical Evaluation
- 2026Reasoning aligns language models to human cognition
- 2025Beyond World Models: Rethinking Understanding in AI Models
- 2024A Roadmap to Pluralistic Alignment
- 2026When AI Agents Disagree Like Humans: Reasoning Trace Analysis for Human-AI Collaborative Moderation
- 2024Possible Principles for Aligned Structure Learning Agents