mlsanityData to 7 Oct 2026

OpenWorldLib: A Unified Codebase and Definition of Advanced World Models

arXiv 2604.04707 ↗First posted 6 Apr 2026cs.CVcited by 3

On the map: World models → World models for language agents

Abstract (arXiv)

World models have garnered significant attention as a promising research direction in artificial intelligence, yet a clear and unified definition remains lacking. In this paper, we introduce OpenWorldLib, a comprehensive and standardized inference framework for Advanced World Models. Drawing on the evolution of world models, we propose a clear definition: a world model is a model or framework centered on perception, equipped with interaction and long-term memory capabilities, for understanding and predicting the complex world. We further systematically categorize the essential capabilities of world models. Based on this definition, OpenWorldLib integrates models across different tasks within a unified framework, enabling efficient reuse and collaborative inference. Finally, we present additional reflections and analyses on potential future directions for world model research. Code link: https://github.com/OpenDCAI/OpenWorldLib

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 151 of its 166 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

151 of 166 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026The Trinity of Consistency as a Defining Principle for General World Models26 Feb
  2. 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks2 Feb
  3. 2026Visual Generation Unlocks Human-Like Reasoning through Multimodal World Models27 Jan
  4. 2025Web World Models29 Dec
  5. 2025Emu3.5: Native Multimodal Models are World Learners30 Oct
  6. 2025CWM: An Open-Weights LLM for Research on Code Generation with World Models30 Sep
  7. 2025Critique of World Model7 Jul
  8. 2025Cosmos World Foundation Model Platform for Physical AI7 Jan
  9. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Models21 Nov

Other references · 142

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2023Qwen Technical Reportcited by 3,273
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  8. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  9. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  10. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  11. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  12. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
38 more
  1. 2018World Modelscited by 1,444
  2. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  3. 2023Mastering Diverse Domains through World Modelscited by 1,193
  4. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  5. 2025Large Language Diffusion Modelscited by 872
  6. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  7. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  8. 2025Qwen2.5-Omni Technical Reportcited by 704
  9. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
  10. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  11. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  12. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
  13. 2025Continuous 3D Perception Model with Persistent Statecited by 527
  14. 2025Qwen3-Omni Technical Reportcited by 451
  15. 2025Seed1.5-VL Technical Reportcited by 367
  16. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  17. 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 348
  18. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  19. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 321
  20. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  21. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
  22. 2026Causal World Modeling for Robot Controlcited by 289
  23. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  24. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
  25. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
  26. 2025Video models are zero-shot learners and reasonerscited by 208
  27. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  28. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
  29. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 186
  30. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  31. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 178
  32. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 178
  33. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 175
  34. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 174
  35. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
  36. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 152
  37. 2026Advancing Open-source World Modelscited by 144
  38. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 136

50 most cited of 142 All 142 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

  1. 2026WorldOlympiad: Can Your World Model Survive a Triathlon?cited by 4
  2. 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-trainingcited by 2
  3. 2026VGGT-Edit: Feed-forward Native 3D Scene Editing with Residual Field Predictioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation
  2. 2024Making Large Language Models into World Models with Precondition and Effect Knowledge
  3. 2025World-in-World: World Models in a Closed-Loop World
  4. 2024Elements of World Knowledge (EWoK): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language Models
  5. 2026Graph World Models: Concepts, Taxonomy, and Future Directions
  6. 2025From monoliths to modules: Decomposing transducers for efficient world modelling
  7. 2026A Tutorial on World Models and Physical AI
  8. 2025From Masks to Worlds: A Hitchhiker's Guide to World Models