mlsanityData to 7 Oct 2026

Mental World Modeling

arXiv 2607.27201 ↗First posted 29 Jul 2026cs.CLcited by 1

On the map: World models → World models for language agents

Abstract (arXiv)

World models enable a predictive substrate for planning and action, yet existing formulations merely answer a physical question: what/where it is, and how will it evolve. Human behavior, however, is driven by hidden mental state (what a person believes, wants, intends, feels, and considers socially permissible), so a model that tracks the physical scene but not what each agent knows and believes about it predicts the wrong action for the right-looking scene. We formulate Mental World Modeling (MWM), a generic theoretical framework that makes mental variables core components of a world model rather than posthoc rationales: MWM aintains a coupled physical-mental world state, renders a target-specific partial observation, and simulates how candidate actions jointly update both components. We instantiate the framework in MENTIS, a training-free and fully inspectable baseline that decomposes the process into state parsing, target-observation generation, action decomposition, coupled physical and mental transition, and branch-level value evaluation. On a manually constructed, quality-controlled dataset of situated decision scenarios spanning text, image, and sounding-video stories, experiments with 8 modern LLM-based world models demonstrate that explicitly modeling the mental state is essential for predicting human decisions. Deeper analyses further expose the bottlenecks of current mental world modeling. We expect MWM as a next stage of world modeling, from simulating physical scenes to simulating the minds that act in them.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 34 of its 59 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

34 of 59 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications28 May
  2. 2025Social World Models30 Aug
  3. 2025Cosmos World Foundation Model Platform for Physical AI7 Jan
  4. 2023Reasoning with Language Model is Planning with World Model24 May
  5. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
  6. 2023Evaluating Large Language Models in Theory of Mind Tasks4 Feb
  7. 2020Language Models are Few-Shot Learners28 May

Other references · 27

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2023Visual Instruction Tuningcited by 7,792
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  7. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  8. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  9. 2018World Modelscited by 1,444
  10. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  11. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  12. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
15 more
  1. 2024Genie: Generative Interactive Environmentscited by 706
  2. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
  3. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
  4. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 350
  5. 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 288
  6. 2018Machine Theory of Mindcited by 222
  7. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 178
  8. 2023FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactionscited by 162
  9. 2025Training Agents Inside of Scalable World Modelscited by 122
  10. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
  11. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 86
  12. 2024ToMBench: Benchmarking Theory of Mind in Large Language Modelscited by 70
  13. 20253D and 4D World Modeling: A Surveycited by 64
  14. 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 34
  15. 2026NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle Simulationcited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Human Cognition in Machines: A Unified Perspective of World Models
  2. 2025Modeling the Mental World for Embodied AI: A Comprehensive Review
  3. 2025Large Emotional World Model
  4. 2025Beyond World Models: Rethinking Understanding in AI Models
  5. 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
  6. 2025World-in-World: World Models in a Closed-Loop World
  7. 2026World Reasoning Arena
  8. 2026Latent State Design for World Models under Sufficiency Constraints