mlsanityData to 7 Oct 2026

OSCAR: Omni-Embodiment Action-Conditioned World Model for Robotics

arXiv 2606.04463 ↗First posted 3 Jun 2026cs.ROcited by 6

On the map: World models → Embodied and robot world models

Abstract (arXiv)

We present OSCAR, a precise action-conditioned video world model that generalizes across different robot embodiments and enables robot policy evaluation. Existing video world models face three main challenges for real-world robot evaluation: limited scenario diversity in current robot training datasets, imprecise action following, and poor generalization across embodiments for broad adoption. We tackle these challenges from two perspectives. At its core is a large-scale standardized data pipeline that curates, filters, and deduplicates broad robotics and egocentric human datasets, yielding a clean joint-training dataset that spans diverse tasks, scenarios, actions, and robot embodiments. To condition the video model, we adopt 2D kinematic skeleton rendering as a unified conditioning representation that generalizes across different robot arms or even human hands. We finetune the Cosmos-Predict2.5-2B model on a single GH200 GPU. Our model achieves significant improvement on action following, appearance quality, and motion consistency, compared to existing baselines, which either have a much larger model size or require more GPUs. We further deploy OSCAR to evaluate robot policies from RoboArena. Extensive experiments demonstrate the significant correlation between our virtual policy evaluation in OSCAR and real-world evaluation, paving the way for the future where robot policies can be purely evaluated in virtual generated worlds.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 20 of its 50 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

20 of 50 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation17 Mar
  2. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
  3. 2025Scalable Policy Evaluation with Video World Models14 Nov
  4. 2025WorldGym: World Model as An Environment for Policy Evaluation31 May
  5. 2025WorldEval: World Model as Real-World Robot Policies Evaluator25 May

Other references · 15

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  4. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  5. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  6. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  7. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  8. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  9. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
  10. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  11. 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
  12. 2025Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videoscited by 63
3 more
  1. 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 46
  2. 2025EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Modelscited by 45
  3. 2025AIRoA MoMa Dataset: A Large-Scale Hierarchical Dataset for Mobile Manipulationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026XEWorld: Can Action-Conditioned World Models Generalize to Unseen Robot Embodiments?
  2. 2026Cross-Embodiment Robot Foundation World Models with Latent Actions
  3. 2026CLAP: Cross-Embodiment Video World Models are Zero-Shot Physical Simulators
  4. 2026LD4WAM: Learning Latent Dynamics from Human Videos for World Action Models
  5. 2026World Action Models are Zero-shot Policies
  6. 2026Interactive World Simulator for Robot Policy Training and Evaluation
  7. 2026Turning Video Models into Generalist Robot Policies
  8. 2026BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Masks