Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks
On the map: World models → World models for language agents
Abstract (arXiv)
World models have emerged as a critical frontier in AI research, aiming to enhance large models by infusing them with physical dynamics and world knowledge. The core objective is to enable agents to understand, predict, and interact with complex environments. However, current research landscape remains fragmented, with approaches predominantly focused on injecting world knowledge into isolated tasks, such as visual prediction, 3D estimation, or symbol grounding, rather than establishing a unified definition or framework. While these task-specific integrations yield performance gains, they often lack the systematic coherence required for holistic world understanding. In this paper, we analyze the limitations of such fragmented approaches and propose a unified design specification for world models. We suggest that a robust world model should not be a loose collection of capabilities but a normative framework that integrally incorporates interaction, perception, symbolic reasoning, and spatial representation. This work aims to provide a structured perspective to guide future research toward more general, robust, and principled models of the world.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 91 of its 100 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
91 of 100 references.
Closest ancestors · 2
Same direction, newest first
- 2025Cosmos World Foundation Model Platform for Physical AI7 Jan
- 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
Other references · 89
- 2023GPT-4 Technical Reportcited by 18,132
- 2025Qwen3 Technical Reportcited by 8,195
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2023Qwen Technical Reportcited by 3,273
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
38 more
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2018World Modelscited by 1,444
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2024xLSTM: Extended Long Short-Term Memorycited by 320
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 281
- 2024Navigation World Modelscited by 262
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
- 2025Video models are zero-shot learners and reasonerscited by 208
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 178
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 174
- 2025Native and Compact Structured Latents for 3D Generationcited by 157
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 152
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 100
- 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Modelscited by 94
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
- 2025JavisDiT: Joint Audio-Video Diffusion Transformer with Hierarchical Spatio-Temporal Prior Synchronizationcited by 84
- 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environmentscited by 69
- 2023ZONE: Zero-Shot Instruction-Guided Local Editingcited by 61
- 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 60
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Modelcited by 58
50 most cited of 89 All 89 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Beyond World Models: Rethinking Understanding in AI Models
- 2025World-in-World: World Models in a Closed-Loop World
- 2026A Tutorial on World Models and Physical AI
- 2026From Perception to Action: Spatial AI Agents and World Models
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
- 2025From 2D to 3D Cognition: A Brief Survey of General World Models
- 2025A Comprehensive Survey on World Models for Embodied AI
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications