mlsanityData to 7 Oct 2026

DreamTrue: Action-Faithful Robot World Model with Counterfactual Post-Training

arXiv 2610.12468 ↗First posted 8 Oct 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present DreamTrue, a multi-view, cross-embodiment robot world model for action-faithful and physically plausible video prediction. Training such a model on existing robot datasets faces two obstacles: imprecise calibration can impair action following, while limited coverage of unsuccessful interactions can bias predictions toward successful outcomes. To improve action following across embodiments, we render action trajectories into image-space conditions and introduce offline geometric calibration to align these conditions with the target videos. To broaden interaction coverage, we introduce counterfactual post-training, modifying recorded action trajectories and generating future videos under a wider range of actions and contact configurations. To provide feedback on these predictions without paired ground-truth futures, we construct a human-annotated video dataset covering robot, object, and interaction defects and use it to train an embodied video reward model. Its scores guide reinforcement-learning post-training toward more physically plausible interaction outcomes. On AgiBot, DreamTrue attains state-of-the-art action following, while reducing the human-assessed interaction defect rate from from 48.12% to 6.25%. Notably, our model ranks first in the world model track of the AgiBot World Challenge 2026. The project page can be found at https://brave-eai.github.io/DreamTrue.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 58 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

35 of 58 references.

References · 35

  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  3. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  4. 2025SAM 3: Segment Anything with Conceptscited by 835
  5. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  6. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  7. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  8. 2025VACE: All-in-One Video Creation and Editingcited by 467
  9. 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 187
  10. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  11. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 175
  12. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 149
23 more
  1. 2026Qwen3.5-Omni Technical Reportcited by 146
  2. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 117
  3. 2024IRASim: A Fine-Grained World Model for Robot Manipulationcited by 93
  4. 2023Diffusion Models for Reinforcement Learning: A Surveycited by 84
  5. 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulationcited by 74
  6. 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Modelscited by 68
  7. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 68
  8. 2025A Comprehensive Survey on World Models for Embodied AIcited by 65
  9. 2025Evaluating Gemini Robotics Policies in a Veo World Simulatorcited by 50
  10. 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 46
  11. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Modelscited by 45
  12. 2025EnerVerse-AC: Envisioning Embodied Environments with Action Conditioncited by 40
  13. 2026VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Modelcited by 39
  14. 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 32
  15. 2025RoboMIND 2.0: A Multimodal, Bimanual Mobile Manipulation Dataset for Generalizable Embodied Intelligencecited by 31
  16. 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 22
  17. 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Modelscited by 21
  18. 2026BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Maskscited by 19
  19. 2026PlayWorld: Learning Robot World Models from Autonomous Playcited by 16
  20. 2026Flow-Factory: A Unified Framework for Reinforcement Learning in Flow-Matching Modelscited by 10
  21. 2026Masked Visual Actions for Unified World Modelingcited by 7
  22. 2026GE-Sim 2.0: A Roadmap Towards Comprehensive Closed-loop Video World Simulators for Robotic Manipulationcited by 6
  23. 2026FACT: Failure-Aware Causal Training for World-Action Modelscited by 3

Built on by

Not cited yet.