MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignment
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Scalable embodied intelligence is constrained by the scarcity of diverse, long-horizon robotic manipulation data. Existing video world models in this domain are limited to synthesizing short clips of simple actions and often rely on manually defined trajectories. To this end, we introduce MIND-V, a cognitive hierarchical world model designed to synthesize physically plausible and logically coherent videos of long-horizon robotic manipulation. Inspired by cognitive science, MIND-V bridges high-level reasoning with pixel-level synthesis through three core components: a Semantic Reasoning Hub (SRH) that leverages a pre-trained vision-language model for task planning; a Behavioral Semantic Bridge (BSB) that translates abstract instructions into domain-invariant representations; and a Motor Video Generator (MVG) for conditional video rendering. MIND-V employs Staged Visual Future Rollouts, a test-time optimization strategy to enhance long-horizon robustness. To enforce adherence to physical laws, we introduce a GRPO reinforcement learning post-training phase guided by a novel Physical Foresight Coherence (PFC) reward. PFC leverages the V-JEPA2 world model as a physics referee to penalize implausible dynamics in the latent feature space. Experiments confirm MIND-V's SOTA performance in long-horizon simulation and its significant value for policy learning, introducing a scalable and fully autonomous framework for embodied data synthesis.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 50 of its 61 references that are in the map. First posted on arXiv 7 Dec 2025.
Builds on
50 of 61 references.
Closest ancestors · 4
Same direction, newest first
- 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Models12 Nov
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
- 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
- 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr
Other references · 46
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
34 more
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
- 2023Learning to Act from Actionless Videos through Dense Correspondencescited by 164
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
- 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
- 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 135
- 2025Controllable Video Generation: A Surveycited by 98
- 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 67
- 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 59
- 2025Igniting VLMs toward the Embodied Spacecited by 53
- 2025Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Controlcited by 34
- 2025FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Modelcited by 32
- 2024MuseTalk: Real-Time High-Fidelity Video Dubbing via Spatio-Temporal Samplingcited by 28
- 2025Affordance-R1: Reinforcement Learning for Generalizable Affordance Reasoning in Multimodal Large Language Modelcited by 23
- 2025AnyTalker: Scaling Multi-Person Talking Video Generation with Interactivity Refinementcited by 20
- 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGCcited by 12
- 2025VidSketch: Hand-drawn Sketch-Driven Video Generation with Diffusion Controlcited by 9
- 2025Zo3T: Zero-Shot 3D-Aware Trajectory-Guided Image-to-Video Generation via Test-Time Trainingcited by 9
- 2025Controllable Layer Decomposition for Reversible Multi-Layer Image Generationcited by 9
- 2025RoBridge: A Hierarchical Architecture Bridging Cognition and Execution for General Robotic Manipulationcited by 8
- 2025Inferix: A Block-Diffusion based Next-Generation Inference Engine for World Simulationcited by 8
- 2025FDG-Diff: Frequency-Domain-Guided Diffusion Framework for Compressed Hazy Image Restorationcited by 4
- 2025Improving the Physics of Video Generation with VJEPA-2 Reward Signalcited by 4
- 2025MARL-MambaContour: Unleashing Multi-Agent Deep Reinforcement Learning for Active Contour Optimization in Medical Image Segmentationcited by 3
- 2025RPD-Diff: Region-Adaptive Physics-Guided Diffusion Model for Visibility Enhancement under Dense and Non-Uniform Hazecited by 1
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026KVPO: ODE-Native GRPO for Autoregressive Video Alignment via KV Semantic Explorationcited by 11
- 2026RoboStereo: Dual-Tower 4D Embodied World Models for Unified Policy Optimizationcited by 10
- 2026PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulationcited by 10
- 2026World-Action Models for Robot Learning and Control: A Surveycited by 6
- 2026PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Modelscited by 2
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Modelscited by 0
- 2026GDLAM: Group-Disentangled Latent Action Model for Highly Disentangled Embodied Pretrainingcited by 0
- 2026Memory Forcing: Attendable Mid-Horizon History for Streaming Video Generationcited by 0
- 2026ContourVLA: A Closed-Loop Perception-Action Contour Policy for Generalized Referring Expression Segmentationcited by 0
- 2026ContourVLA: A Closed-Loop Perception-Action Contour Policy for Generalized Referring Expression Segmentation8 Oct 2026
- 2026Memory Forcing: Attendable Mid-Horizon History for Streaming Video Generation8 Oct 2026
- 2026World-Action Models for Robot Learning and Control: A Survey13 Sep 2026
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models3 Sep 2026
- 2026GDLAM: Group-Disentangled Latent Action Model for Highly Disentangled Embodied Pretraining10 Aug 2026
- 2026PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulation26 Jun 2026
- 2026PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models25 Jun 2026
- 2026KVPO: ODE-Native GRPO for Autoregressive Video Alignment via KV Semantic Exploration14 May 2026
- 2026RoboStereo: Dual-Tower 4D Embodied World Models for Unified Policy Optimization13 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking World-Action Model for Compositional and In-Context Robotic Manipulation
- 2026Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-horizon Manipulation
- 2026PHR-VLA: Planning Horizon Reasoning for Vision-Language-Action Models
- 2025Reflective Planning: Vision-Language Models for Multi-Stage Long-Horizon Robotic Manipulation
- 2026NovaPlan: Zero-Shot Long-Horizon Manipulation via Closed-Loop Video Language Planning
- 2026DreamPlan: Efficient Reinforcement Fine-Tuning of Vision-Language Planners via Video World Models
- 2026JoyAI-RA 0.5: Scaling Robot Manipulation Learning via Dual Action Alignment
- 2026Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation