mlsanityData to 7 Oct 2026

Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulation

arXiv 2508.05635 ↗First posted 7 Aug 2025cs.RO cs.CVcited by 129

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

We introduce Genie Envisioner (GE), a unified world foundation platform for robotic manipulation that integrates policy learning, evaluation, and simulation within a single video-generative framework. At its core, GE-Base is a large-scale, instruction-conditioned video diffusion model that captures the spatial, temporal, and semantic dynamics of real-world robotic interactions in a structured latent space. Built upon this foundation, GE-Act maps latent representations to executable action trajectories through a lightweight, flow-matching decoder, enabling precise and generalizable policy inference across diverse embodiments with minimal supervision. To support scalable evaluation and training, GE-Sim serves as an action-conditioned neural simulator, producing high-fidelity rollouts for closed-loop policy development. The platform is further equipped with EWMBench, a standardized benchmark suite measuring visual fidelity, physical consistency, and instruction-action alignment. Together, these components establish Genie Envisioner as a scalable and practical foundation for instruction-driven, general-purpose embodied intelligence. All code, models, and benchmarks will be released publicly.

Key facts. Cited by 129 papers in the map (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 44 of its 58 references that are in the map. First posted on arXiv 7 Aug 2025.

Builds on

44 of 58 references.

References · 44

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  6. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  7. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  9. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  10. 2022Video Diffusion Modelscited by 2,280
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  12. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
32 more
  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  2. 2018World Modelscited by 1,444
  3. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  4. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  5. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  6. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
  7. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  8. 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 753
  9. 2024Genie: Generative Interactive Environmentscited by 706
  10. 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 678
  11. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  12. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  13. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  14. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
  15. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  16. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  17. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  18. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  19. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
  20. 2022DayDreamer: World Models for Physical Robot Learningcited by 372
  21. 2016Unsupervised Learning for Physical Interaction through Video Predictioncited by 256
  22. 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 220
  23. 2019Deep Dynamics Models for Learning Dexterous Manipulationcited by 200
  24. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 178
  25. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
  26. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Modelscited by 168
  27. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
  28. 2023Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Modelcited by 115
  29. 2019General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warpingcited by 102
  30. 2025EnerVerse: Envisioning Embodied Future Space for Robotics Manipulationcited by 59
  31. 2025AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real Worldcited by 46
  32. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Modelscited by 45

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 20; 2026: 109.

129 papers.

Sort:

By area:

  1. 2026World Action Models are Zero-shot Policiescited by 411
  2. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
  3. 2025Memory in the Age of AI Agentscited by 285
  4. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  5. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 195
  6. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  7. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 149
  8. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 85
  9. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
  10. 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Controlcited by 71
  11. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 68
  12. 2026Being-H0.7: A Latent World-Action Model from Egocentric Videoscited by 68
38 more
  1. 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoisingcited by 65
  2. 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AIcited by 60
  3. 2026Motubrain: An Advanced World Action Model for Robot Controlcited by 54
  4. 2026InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulationcited by 48
  5. 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 46
  6. 2026World Action Models: The Next Frontier in Embodied AIcited by 46
  7. 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Modelcited by 43
  8. 2025DriveLaW:Unifying Planning and Video Generation in a Latent Driving Worldcited by 43
  9. 2026World Model for Robot Learning: A Comprehensive Surveycited by 42
  10. 2026Do World Action Models Generalize Better than VLAs? A Robustness Studycited by 35
  11. 2026Hierarchical Planning with Latent World Modelscited by 34
  12. 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?cited by 33
  13. 2026ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Modelscited by 30
  14. 2026Rethinking Video Generation Model for the Embodied Worldcited by 30
  15. 2026Native Video-Action Pretraining for Generalizable Robot Controlcited by 30
  16. 2026ReMem-VLA: Empowering Vision-Language-Action Model with Memory via Dual-Level Recurrent Queriescited by 28
  17. 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulationcited by 25
  18. 2026GigaBrain-0.5M*: a VLA That Learns From World Model-Based Reinforcement Learningcited by 23
  19. 2026ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics Alignmentcited by 23
  20. 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 22
  21. 2026BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Maskscited by 19
  22. 2026Light-WAM: Efficient World Action Models with State-Fusion Action Decodingcited by 19
  23. 2025Act2Goal: From World Model To General Goal-conditioned Policycited by 18
  24. 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulationcited by 17
  25. 2025A Step Toward World Models: A Survey on Robotic Manipulationcited by 15
  26. 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
  27. 2025Vidarc: Embodied Video Diffusion Model for Closed-loop Controlcited by 15
  28. 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Modelscited by 15
  29. 2026MaskWAM: Unifying Mask Prompting and Prediction for World-Action Modelscited by 15
  30. 2026EVA: Aligning Video World Models with Executable Robot Actions via Inverse Dynamics Rewardscited by 14
  31. 2026VTAM: Video-Tactile-Action Models for Complex Physical Interaction Beyond VLAscited by 14
  32. 2026WALL-WM: Carving World Action Modeling at the Event Jointscited by 14
  33. 2025Video2Act: A Dual-System Video Diffusion Policy with Robotic Spatio-Motional Modelingcited by 13
  34. 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systemscited by 13
  35. 2026Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligencecited by 13
  36. 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Modelscited by 10
  37. 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigationcited by 10
  38. 2026World Action Models: A Surveycited by 10

50 most cited of 129 All 129 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026GE-Sim 2.0: A Roadmap Towards Comprehensive Closed-loop Video World Simulators for Robotic Manipulation
  2. 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
  3. 2026Causal World Modeling for Robot Control
  4. 2026ω-EVA: Envision, Verify, and Act with Latent Interactive World Models
  5. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  6. 2025World4RL: Diffusion World Models for Policy Refinement with Reinforcement Learning for Robotic Manipulation
  7. 2026Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation
  8. 2026World Models for Robotic Manipulation: A Survey