mlsanityData to 14 Oct 2026

SyncWorld: Visual Calibration Enables World Models as Zero-Shot Simulators

arXiv 2609.09155 ↗First posted 8 Sep 2026cs.CVcited by 1

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World models are increasingly used as policy-in-the-loop imagination environments, where reliable rollouts require fine-grained controllability with respect to low-level robot actions. A key obstacle to scaling such models in robotics is that actions are not a universal language in pixel space: changes in visual environment, camera view, robot placement, or embodiment alter how the same numerical action manifests visually, leading to conflicting supervision under mixed training and brittle generalization at deployment. We introduce SyncWorld, an action-conditioned world model that serves as a zero-shot simulator across unseen environments without any additional training. SyncWorld leverages a visual calibration episode---paired frames and actions that showcase all the controllable degrees of freedom---to specify the setup-specific Action--Visual Mapping in context. Training with visual calibration contexts teaches the model to interpret actions through visual evidence and to leverage interaction history when explicit calibration is unavailable. Experiments show that SyncWorld can accurately simulate action outcomes in previously unseen settings, and that its capability of simulating rollouts enables test-time policy improvement without training.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 59 of its 76 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

59 of 76 references.

Closest ancestors · 24

Same direction, newest first

  1. 2026AdaWorldPolicy: World-Model-Driven Diffusion Policy with Online Adaptive Learning for Robotic Manipulation23 Feb
  2. 2026World Action Models are Zero-shot Policies17 Feb
  3. 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL15 Feb
  4. 2026VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Model12 Feb
  5. 2026Olaf-World: Orienting Latent Actions for Video World Modeling10 Feb
  6. 2026MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulation10 Feb
  7. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
  8. 2026World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policy6 Feb
  9. 2026BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Masks3 Feb
  10. 2026World-Gymnast: Training Robots with Reinforcement Learning in a World Model2 Feb
  11. 2026Learning Latent Action World Models In The Wild8 Jan
  12. 2025Latent Action World Models for Control with Unlabeled Trajectories10 Dec
12 more
  1. 2025Scaling Cross-Embodiment World Models for Dexterous Manipulation3 Nov
  2. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
  3. 2025Latent Action Pretraining Through World Modeling22 Sep
  4. 20253DFlowAction: Learning Cross-Embodiment Manipulation from 3D Flow World Model6 Jun
  5. 2025WorldGym: World Model as An Environment for Policy Evaluation31 May
  6. 2025FLARE: Robot Learning with Implicit World Modeling21 May
  7. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
  8. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
  9. 2025AdaWorld: Learning Adaptable World Models with Latent Actions24 Mar
  10. 2025Inference-Time Enhancement of Generative Robot Policies via Predictive World Modeling2 Feb
  11. 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
  12. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models16 Oct

Other references · 35

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  2. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  3. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  4. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  6. 2020Mastering Atari with Discrete World Modelscited by 1,007
  7. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  8. 2024Genie: Generative Interactive Environmentscited by 747
  9. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
  10. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  11. 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
  12. 2023Learning Interactive Real-World Simulatorscited by 458
23 more
  1. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
  2. 2022DayDreamer: World Models for Physical Robot Learningcited by 400
  3. 2024Latent Action Pretraining from Videoscited by 321
  4. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  5. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  6. 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 230
  7. 2025Unified Video Action Modelcited by 205
  8. 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 153
  9. 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 116
  10. 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 111
  11. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 102
  12. 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 87
  13. 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 80
  14. 2026LeRobot: An Open-Source Library for End-to-End Robot Learningcited by 73
  15. 2024Prediction with Action: Visual Policy Learning via Joint Denoising Processcited by 70
  16. 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulationcited by 62
  17. 2024USP: A Unified Sequence Parallelism Approach for Long Context Generative AIcited by 61
  18. 2025EnerVerse-AC: Envisioning Embodied Environments with Action Conditioncited by 42
  19. 2025AnyPos: Automated Task-Agnostic Actions for Bimanual Manipulationcited by 23
  20. 2025Precise Action-to-Video Generation Through Visual Action Promptscited by 15
  21. 2025Video-As-Prompt: Unified Semantic Control for Video Generationcited by 14
  22. 2026StableWorld: Towards Stable and Consistent Long Interactive Video Generationcited by 12
  23. 2025Context and Diversity Matter: The Emergence of In-Context Learning in World Modelscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Masked Visual Actions for Unified World Modeling
  2. 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM
  3. 2026XEWorld: Can Action-Conditioned World Models Generalize to Unseen Robot Embodiments?
  4. 2026Do Robotic World Models Really Follow Actions? Diagnosing and Aligning Action-Conditioned Generation for Policy Learning
  5. 2026GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actions
  6. 2026WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulation
  7. 2026Bridge-WA: Predicting Where and How the World Changes for Robotic Action
  8. 2026BWM: A Low-Cost High-Fidelity World Simulator for Robot Learning