mlsanityData to 7 Oct 2026

PAN: A World Model for General, Actionable, and Long-Horizon World Simulation

arXiv 2511.09057 ↗First posted 12 Nov 2025cs.CV cs.AI cs.CLcited by 36

On the map: World models → World models for language agents

Abstract (arXiv)

A world model is a cognitive simulator of the real-world environment allowing biological agents to reason about how the world evolves, whether spontaneously or in response to their actions, and accordingly to plan and strategize. In building Artificial Intelligence (AI) systems, world models represent the next frontier beyond large language models (LLMs) to enable physical and embodied intelligence in AI agents, allowing them to perform decision-making through simulative reasoning and reinforcement-learning through simulative trials. Recent advancements in world modeling have yielded impressive progress in video generation, 3-D scene evolution, robotic dynamics, and game simulation, but limitations persist in general, open-domain, action-driven prediction, long-horizon consistency, and abstract reasoning and planning. Moreover, fundamental architectural questions, whether it be state representation, information flow, or training objectives, remain unresolved. In this paper, we introduce PAN, a world model built on the Generative Latent Prediction (GLP) architecture. GLP combines stateful latent representations of world states; an encoder--decoder closed-loop information flow; an LLM/diffusion-based mixed reasoning backbone; and a non-degenerate generative reconstruction objective whose fidelity is ``dampable'' to balance fine-grained detail against semantic saliency. Compared to several existing systems, PAN demonstrates advantages beyond standard video generation in action-conditioned world simulation, long-horizon forecasting, and simulative reasoning and planning, capabilities we argue should serve as the primary criteria for evaluating world models.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 60 of its 87 references that are in the map. First posted on arXiv 12 Nov 2025.

Builds on

60 of 87 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025General Agentic Planning Through Simulative Reasoning with World Models31 Jul
  2. 2025Critique of World Model7 Jul
  3. 2025Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation27 Jun
  4. 2023Reasoning with Language Model is Planning with World Model24 May
  5. 2023Language Models Meet World Models: Embodied Experiences Enhance Language Models18 May

Other references · 55

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2022Classifier-Free Diffusion Guidancecited by 5,717
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2022Flow Matching for Generative Modelingcited by 5,426
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  12. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
38 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  2. 2018World Modelscited by 1,444
  3. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
  4. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  5. 2023Mastering Diverse Domains through World Modelscited by 1,193
  6. 2020Mastering Atari with Discrete World Modelscited by 990
  7. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  8. 2018DeepMind Control Suitecited by 935
  9. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  10. 2024Genie: Generative Interactive Environmentscited by 706
  11. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
  12. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  13. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 507
  14. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
  15. 2023Learning Interactive Real-World Simulatorscited by 440
  16. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  17. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
  18. 2016YouTube-8M: A Large-Scale Video Classification Benchmarkcited by 324
  19. 2022Transformers are Sample-Efficient World Modelscited by 317
  20. 2021MERLOT: Multimodal Neural Script Knowledge Modelscited by 311
  21. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
  22. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
  23. 2023Generating Images with Multimodal Language Modelscited by 259
  24. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 258
  25. 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 239
  26. 2022Interactive Language: Talking to Robots in Real Timecited by 217
  27. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 186
  28. 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 180
  29. 2023Denoising Diffusion Bridge Modelscited by 171
  30. 2018Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysiscited by 154
  31. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 147
  32. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
  33. 2024HART: Efficient Visual Generation with Hybrid Autoregressive Transformercited by 128
  34. 2021Sequence Parallelism: Long Sequence Training from System Perspectivecited by 125
  35. 2025Fast Video Generation with Sliding Tile Attentioncited by 123
  36. 2025VSA: Faster Video Diffusion with Trainable Sparse Attentioncited by 100
  37. 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraftcited by 93
  38. 2024MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizercited by 80

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 33.

36 papers.

Sort:

By area:

  1. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 152
  2. 2026Advancing Open-source World Modelscited by 144
  3. 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
  4. 2026LLM-as-a-Verifier: A General-Purpose Verification Frameworkcited by 21
  5. 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Modelscited by 20
  6. 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 13
  7. 2026World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetrycited by 13
  8. 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 13
  9. 2025SimWorld: An Open-ended Realistic Simulator for Autonomous Agents in Physical and Social Worldscited by 10
  10. 2026GigaWorld-1: A Roadmap to Build World Models for Robot Policy Evaluationcited by 10
  11. 2026Code World Model: Coding Agent as World Braincited by 9
  12. 2026Flow Equivariant World Models: Memory for Partially Observed Dynamic Environmentscited by 6
24 more
  1. 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Modelcited by 6
  2. 2026Evolution of Video Generative Foundationscited by 6
  3. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
  4. 2026Human Cognition in Machines: A Unified Perspective of World Modelscited by 5
  5. 2026BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregressioncited by 5
  6. 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
  7. 2025Spectral Representation-based Reinforcement Learningcited by 3
  8. 2026World-Ego Modeling for Long-Horizon Evolution in Hybrid Embodied Taskscited by 2
  9. 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memorycited by 2
  10. 2026AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customizationcited by 2
  11. 2026Critique of Agent Modelcited by 2
  12. 2026MoWorld: A Flash World Modelcited by 2
  13. 2026PhiZero: A World Model Built Around Physical Languagecited by 2
  14. 2026World Reasoning Arenacited by 1
  15. 2026Efficient Agentic Reasoning Through Self-Regulated Simulative Planningcited by 1
  16. 2026Music-JEPA: Learning a World Model of Sound from Actioncited by 1
  17. 2026Oneira: From Open-Ended Generation to Open-World Interaction in Video World Modelscited by 1
  18. 2026From Control to Foresight: Simulation as a New Paradigm for Human-Agent Collaborationcited by 0
  19. 2026Business World Modelcited by 0
  20. 2026Textual Belief States for World Models: Identifiable Representation Learning Under Strict Mediationcited by 0
  21. 2026Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Modelscited by 0
  22. 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
  23. 2026Memorizon: Training World Models Beyond Their Context Windowcited by 0
  24. 2026RoboJEPA: Scaling Robotic Latent World Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications
  2. 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
  3. 2025World-in-World: World Models in a Closed-Loop World
  4. 2025World Models for Cognitive Agents: Transforming Edge Intelligence in Future Networks
  5. 2026Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modeling
  6. 2026Physically Native World Models: A Hamiltonian Perspective on Generative World Modeling
  7. 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks
  8. 2026A Tutorial on World Models and Physical AI