RoboStereo: Dual-Tower 4D Embodied World Models for Unified Policy Optimization
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Scalable Embodied AI faces fundamental constraints due to prohibitive costs and safety risks of real-world interaction. While Embodied World Models (EWMs) offer promise through imagined rollouts, existing approaches suffer from geometric hallucinations and lack unified optimization frameworks for practical policy improvement. We introduce RoboStereo, a symmetric dual-tower 4D world model that employs bidirectional cross-modal enhancement to ensure spatiotemporal geometric consistency and alleviate physics hallucinations. Building upon this high-fidelity 4D simulator, we present the first unified framework for world-model-based policy optimization: (1) Test-Time Policy Augmentation (TTPA) for pre-execution verification, (2) Imitative-Evolutionary Policy Learning (IEPL) leveraging visual perceptual rewards to learn from expert demonstrations, and (3) Open-Exploration Policy Learning (OEPL) enabling autonomous skill discovery and self-correction. Comprehensive experiments demonstrate RoboStereo achieves state-of-the-art generation quality, with our unified framework delivering >97% average relative improvement on fine-grained manipulation tasks.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 28 of its 52 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
28 of 52 references.
Closest ancestors · 6
Same direction, newest first
- 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignment7 Dec
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AI25 Nov
- 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Models12 Nov
- 2025WristWorld: Generating Wrist-Views via 4D World Models for Robotic Manipulation8 Oct
- 2025VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulators1 Oct
- 2025TesserAct: Learning 4D Embodied World Models29 Apr
Other references · 22
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
- 2025Ovi: Twin Backbone Cross-Modal Fusion for Audio-Video Generationcited by 76
10 more
- 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 66
- 2025Igniting VLMs toward the Embodied Spacecited by 53
- 2025TGRPO :Fine-tuning Vision-Language-Action Model via Trajectory-wise Group Relative Policy Optimizationcited by 47
- 2025Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Controlcited by 33
- 2025SAM-R1: Leveraging SAM for Reward Feedback in Multimodal Segmentation via Reinforcement Learningcited by 31
- 2025Vidarc: Embodied Video Diffusion Model for Closed-loop Controlcited by 15
- 2024Alignment is All You Need: A Training-free Augmentation Strategy for Pose-guided Video Generationcited by 10
- 2025One4D: Unified 4D Generation and Reconstruction via Decoupled LoRA Controlcited by 8
- 2025Inferix: A Block-Diffusion based Next-Generation Inference Engine for World Simulationcited by 8
- 2025Zo3T: Zero-Shot 3D-Aware Trajectory-Guided Image-to-Video Generation via Test-Time Trainingcited by 7
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?cited by 33
- 2026KVPO: ODE-Native GRPO for Autoregressive Video Alignment via KV Semantic Explorationcited by 9
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Modelscited by 9
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Modelcited by 8
- 2026When Should the Teacher Move? Temporal Coupling and Stability in Self On-Policy Distillationcited by 6
- 2026PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Modelscited by 2
- 2026Memory Forcing: Attendable Mid-Horizon History for Streaming Video Generationcited by 0
- 2026ContourVLA: A Closed-Loop Perception-Action Contour Policy for Generalized Referring Expression Segmentationcited by 0
- 2026WorldCast: Distributed Multiplayer World Modelscited by 0
- 2026WorldCast: Distributed Multiplayer World Models8 Oct 2026
- 2026ContourVLA: A Closed-Loop Perception-Action Contour Policy for Generalized Referring Expression Segmentation8 Oct 2026
- 2026Memory Forcing: Attendable Mid-Horizon History for Streaming Video Generation8 Oct 2026
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models2 Sep 2026
- 2026PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models25 Jun 2026
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun 2026
- 2026When Should the Teacher Move? Temporal Coupling and Stability in Self On-Policy Distillation2 Jun 2026
- 2026KVPO: ODE-Native GRPO for Autoregressive Video Alignment via KV Semantic Exploration14 May 2026
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Model7 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025RoboScape-R: Unified Reward-Observation World Models for Generalizable Robotics Training via RL
- 2026Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimization
- 2026WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulation
- 2025World4RL: Diffusion World Models for Policy Refinement with Reinforcement Learning for Robotic Manipulation
- 2026OrbiSim: World Models as Differentiable Physics Engines for Embodied Intelligence
- 2026FluxVLA Engine: A One-Stop VLA Engineering Platform for Embodied Intelligence
- 2026Speedup Patch: Learning a Plug-and-Play Policy to Accelerate Embodied Manipulation
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence