OSCAR: Omni-Embodiment Action-Conditioned World Model for Robotics
On the map: World models → Embodied and robot world models
Abstract (arXiv)
We present OSCAR, a precise action-conditioned video world model that generalizes across different robot embodiments and enables robot policy evaluation. Existing video world models face three main challenges for real-world robot evaluation: limited scenario diversity in current robot training datasets, imprecise action following, and poor generalization across embodiments for broad adoption. We tackle these challenges from two perspectives. At its core is a large-scale standardized data pipeline that curates, filters, and deduplicates broad robotics and egocentric human datasets, yielding a clean joint-training dataset that spans diverse tasks, scenarios, actions, and robot embodiments. To condition the video model, we adopt 2D kinematic skeleton rendering as a unified conditioning representation that generalizes across different robot arms or even human hands. We finetune the Cosmos-Predict2.5-2B model on a single GH200 GPU. Our model achieves significant improvement on action following, appearance quality, and motion consistency, compared to existing baselines, which either have a much larger model size or require more GPUs. We further deploy OSCAR to evaluate robot policies from RoboArena. Extensive experiments demonstrate the significant correlation between our virtual policy evaluation in OSCAR and real-world evaluation, paving the way for the future where robot policies can be purely evaluated in virtual generated worlds.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 20 of its 50 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
20 of 50 references.
Closest ancestors · 5
Same direction, newest first
- 2026Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation17 Mar
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
- 2025Scalable Policy Evaluation with Video World Models14 Nov
- 2025WorldGym: World Model as An Environment for Policy Evaluation31 May
- 2025WorldEval: World Model as Real-World Robot Policies Evaluator25 May
Other references · 15
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
- 2025World Simulation with Video Foundation Models for Physical AIcited by 183
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
- 2025Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videoscited by 63
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulationcited by 2
- 2026Pelican-Sim 1.0: A General World Model Simulator for Embodied Intelligencecited by 1
- 2026Do Robotic World Models Really Follow Actions? Diagnosing and Aligning Action-Conditioned Generation for Policy Learningcited by 0
- 2026Skel-WAM: A Hand-Skeleton-Conditioned World Action Model for Human-to-Robot Manipulation Transfercited by 0
- 2026RoboCoach: World Models as Active Coaches for Compositional Robot Skillscited by 0
- 2026What 30,000 Hours of Ego-centric Video Does Not Teachcited by 0
- 2026What 30,000 Hours of Ego-centric Video Does Not Teach8 Oct 2026
- 2026RoboCoach: World Models as Active Coaches for Compositional Robot Skills30 Sep 2026
- 2026Skel-WAM: A Hand-Skeleton-Conditioned World Action Model for Human-to-Robot Manipulation Transfer18 Sep 2026
- 2026Pelican-Sim 1.0: A General World Model Simulator for Embodied Intelligence10 Sep 2026
- 2026Do Robotic World Models Really Follow Actions? Diagnosing and Aligning Action-Conditioned Generation for Policy Learning25 Aug 2026
- 2026WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulation10 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026XEWorld: Can Action-Conditioned World Models Generalize to Unseen Robot Embodiments?
- 2026Cross-Embodiment Robot Foundation World Models with Latent Actions
- 2026CLAP: Cross-Embodiment Video World Models are Zero-Shot Physical Simulators
- 2026LD4WAM: Learning Latent Dynamics from Human Videos for World Action Models
- 2026World Action Models are Zero-shot Policies
- 2026Interactive World Simulator for Robot Policy Training and Evaluation
- 2026Turning Video Models into Generalist Robot Policies
- 2026BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Masks