mlsanityData to 14 Oct 2026

Flex-π: A Multi-Stream World-Action Model with Compute Flexibility

arXiv 2608.10860 ↗First posted 11 Aug 2026cs.RO cs.CVcited by 11

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

World-action models (WAMs) predict the future to act better, but nearly all of them predict only RGB latents, trained purely for pixel reconstruction, with no explicit signal for the 3D geometry or object semantics manipulation needs. We find a surprising free lunch: the same frozen video-generation VAE that encodes RGB also encodes 3D pointmaps almost losslessly, with no pointmap-specific training at all. This lets us supervise Flex-π, a 6B-parameter WAM, on 3D geometry and object-centric DINO semantics alongside RGB, at no cost in new sensors, new pre-training, or inference latency. Every visual signal is projected into this shared latent space and denoised jointly with actions inside a Mixture-of-Transformers backbone; per-stream dropout with cross-modality forcing then lets a single trained checkpoint run on any subset of these streams, from a fast action-only mode to full joint generation. The result is a policy that is exceptionally demonstration-efficient and generalizes well, beating the strongest baselines by up to 2-7× on dexterous, precise, real-world bimanual manipulation tasks both in and out of distribution, all while running faster than π0.5. Our project website: https://flex-pi.github.io/

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 53 of its 99 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

53 of 99 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar

Other references · 51

  1. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  2. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  4. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  5. 2023Mastering Diverse Domains through World Modelscited by 1,253
  6. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  7. 2020Mastering Atari with Discrete World Modelscited by 1,007
  8. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  9. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  10. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  11. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  12. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
38 more
  1. 2026World Action Models are Zero-shot Policiescited by 465
  2. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  3. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
  4. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
  5. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 328
  6. 2026Causal World Modeling for Robot Controlcited by 321
  7. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
  8. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
  9. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
  10. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
  11. 2025Motus: A Unified Latent Action World Modelcited by 251
  12. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 197
  13. 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 195
  14. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Modelscited by 179
  15. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 139
  16. 2025Interactive Post-Training for Vision-Language-Action Modelscited by 135
  17. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 135
  18. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 127
  19. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 86
  20. 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 83
  21. 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulationcited by 82
  22. 2023RoboCook: Long-Horizon Elasto-Plastic Object Manipulation with Diverse Toolscited by 76
  23. 2025Training Strategies for Efficient Embodied Reasoningcited by 55
  24. 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 50
  25. 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 50
  26. 2025VLA-0: Building State-of-the-Art VLAs with Zero Modificationcited by 49
  27. 2026Native Video-Action Pretraining for Generalizable Robot Controlcited by 36
  28. 2026RLDX-1 Technical Reportcited by 28
  29. 2025ParticleFormer: A 3D Point Cloud World Model for Multi-Object, Multi-Material Robotic Manipulationcited by 26
  30. 2026From Foundation to Application: Improving VLA Models in Practicecited by 26
  31. 2026Steerable Vision-Language-Action Policies for Embodied Reasoning and Hierarchical Controlcited by 20
  32. 2026LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transfercited by 18
  33. 2026PlayWorld: Learning Robot World Models from Autonomous Playcited by 18
  34. 2025Back to Basics: Let Denoising Generative Models Denoisecited by 16
  35. 2025OG-VLA: Orthographic Image Generation for 3D-Aware Vision-Language Action Modelcited by 13
  36. 2025Integrating LMM Planners and 3D Skill Policies for Generalizable Manipulationcited by 8
  37. 2025Multimodal Diffusion Forcing for Forceful Manipulationcited by 4
  38. 2026Modality Forcing for Scalable Spatial Generationcited by 4

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DreamWAM: Beyond RGB Future Prediction for World Action Models
  2. 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising
  3. 2026RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation
  4. 2026DC-WAM: Dynamic-Centric Visual Supervision and Reasoning for World-Action Models
  5. 2026PointAction: 3D Points as Universal Action Representations for Robot Control
  6. 2026XGenAct: Geometry-Enhanced World Action Models through Cross-Task Generation
  7. 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Models
  8. 2026GeoSem-WAM: Geometry- and Semantic-Aware World Action Models