DreamTrue: Action-Faithful Robot World Model with Counterfactual Post-Training
Not on the map. Why?
Abstract (arXiv)
We present DreamTrue, a multi-view, cross-embodiment robot world model for action-faithful and physically plausible video prediction. Training such a model on existing robot datasets faces two obstacles: imprecise calibration can impair action following, while limited coverage of unsuccessful interactions can bias predictions toward successful outcomes. To improve action following across embodiments, we render action trajectories into image-space conditions and introduce offline geometric calibration to align these conditions with the target videos. To broaden interaction coverage, we introduce counterfactual post-training, modifying recorded action trajectories and generating future videos under a wider range of actions and contact configurations. To provide feedback on these predictions without paired ground-truth futures, we construct a human-annotated video dataset covering robot, object, and interaction defects and use it to train an embodied video reward model. Its scores guide reinforcement-learning post-training toward more physically plausible interaction outcomes. On AgiBot, DreamTrue attains state-of-the-art action following, while reducing the human-assessed interaction defect rate from from 48.12% to 6.25%. Notably, our model ranks first in the world model track of the AgiBot World Challenge 2026. The project page can be found at https://brave-eai.github.io/DreamTrue.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 58 references that are in the map. First posted on arXiv 8 Oct 2026.
Builds on
35 of 58 references.
References · 35
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 187
- 2025World Simulation with Video Foundation Models for Physical AIcited by 183
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 175
- 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 149
23 more
- 2026Qwen3.5-Omni Technical Reportcited by 146
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 117
- 2024IRASim: A Fine-Grained World Model for Robot Manipulationcited by 93
- 2023Diffusion Models for Reinforcement Learning: A Surveycited by 84
- 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulationcited by 74
- 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Modelscited by 68
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 68
- 2025A Comprehensive Survey on World Models for Embodied AIcited by 65
- 2025Evaluating Gemini Robotics Policies in a Veo World Simulatorcited by 50
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 46
- 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Modelscited by 45
- 2025EnerVerse-AC: Envisioning Embodied Environments with Action Conditioncited by 40
- 2026VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Modelcited by 39
- 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 32
- 2025RoboMIND 2.0: A Multimodal, Bimanual Mobile Manipulation Dataset for Generalizable Embodied Intelligencecited by 31
- 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 22
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Modelscited by 21
- 2026BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Maskscited by 19
- 2026PlayWorld: Learning Robot World Models from Autonomous Playcited by 16
- 2026Flow-Factory: A Unified Framework for Reinforcement Learning in Flow-Matching Modelscited by 10
- 2026Masked Visual Actions for Unified World Modelingcited by 7
- 2026GE-Sim 2.0: A Roadmap Towards Comprehensive Closed-loop Video World Simulators for Robotic Manipulationcited by 6
- 2026FACT: Failure-Aware Causal Training for World-Action Modelscited by 3
Built on by
Not cited yet.