mlsanityData to 7 Oct 2026

iMaC: Translating Actions into Motion and Contact Images for Embodied World Models

arXiv 2606.09813 ↗First posted 8 Jun 2026cs.RO cs.CVcited by 2

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Embodied world models have emerged as a pivotal paradigm for visual robotic decision-making and interactive environment simulation. However, conventional embodied frameworks rely on low-dimensional structured action vectors (e.g., joint angles and end-effector poses), which suffer from limited expressive capacity, poor generalization across diverse embodiments, and unnatural dynamic modeling for complex physical interactions. To address these limitations, this paper proposesiMac (Image as Action Control), a novel unified control paradigm that treats raw visual images as native action representations for embodied world models. Departing from traditional explicit kinematic action encoding, iMac formulates continuous visual manipulation as image-based action tokens, which inherently encapsulate spatial motion intentions, interactive geometric constraints and subtle physical dynamics. We construct a dual-branch embodied architecture consisting of an image-action encoder and a dynamic world predictor: the encoder compresses target-driven visual images into compact action embeddings, while the predictor learns environment transition rules conditioned on image actions to achieve high-fidelity future state prediction and closed-loop embodied control. Extensive experiments are conducted on public embodied manipulation benchmarks and real-world robotic scenarios. The results demonstrate that iMac outperforms vector-based action control baselines in prediction accuracy, task success rate and cross-scene generalization ability. Moreover, our image-action design eliminates the reliance on manually defined action spaces, realizing flexible and universal control for heterogeneous embodied agents. This work provides an innovative visual-action perspective for embodied world models, offering a simple yet effective paradigm for scalable robotic perception and manipulation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 49 of its 53 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

49 of 53 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026Action Images: End-to-End Policy Learning via Multiview Video Generation7 Apr
  2. 2026ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics Alignment24 Mar
  3. 2026Interactive World Simulator for Robot Policy Training and Evaluation9 Mar
  4. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
  5. 2026Learning Latent Action World Models In The Wild8 Jan
  6. 2025Evaluating Gemini Robotics Policies in a Veo World Simulator11 Dec
  7. 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AI25 Nov
  8. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
  9. 2025WristWorld: Generating Wrist-Views via 4D World Models for Robotic Manipulation8 Oct
  10. 2025World-Env: Leveraging World Model as a Virtual Environment for VLA Post-Training29 Sep
  11. 2025WorldGym: World Model as An Environment for Policy Evaluation31 May
  12. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
2 more
  1. 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr
  2. 2020SAPIEN: A SimulAted Part-based Interactive ENvironment19 Mar

Other references · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  6. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  8. 2023Mastering Diverse Domains through World Modelscited by 1,193
  9. 2020Mastering Atari with Discrete World Modelscited by 990
  10. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  11. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  12. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
23 more
  1. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  2. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  3. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
  4. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  5. 2023Learning Interactive Real-World Simulatorscited by 440
  6. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  7. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
  8. 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulationcited by 135
  9. 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 128
  10. 2025RoboArena: Distributed Real-World Evaluation of Generalist Robot Policiescited by 63
  11. 2024Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Stepcited by 47
  12. 2025AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real Worldcited by 46
  13. 2025EnerVerse-AC: Envisioning Embodied Environments with Action Conditioncited by 40
  14. 2026Image Generators are Generalist Vision Learnerscited by 40
  15. 2025RoboEval: Where Robotic Manipulation Meets Structured and Scalable Evaluationcited by 29
  16. 2025Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactionscited by 27
  17. 2025MimicDreamer: Aligning Human and Robot Demonstrations for Scalable VLA Trainingcited by 24
  18. 2024Robot Learning as an Empirical Science: Best Practices for Policy Evaluationcited by 22
  19. 2025Predictive Red Teaming: Breaking Policies Without Breaking Robotscited by 14
  20. 2024PEGASUS: Physically Enhanced Gaussian Splatting Simulation System for 6DoF Object Pose Dataset Generationcited by 13
  21. 2025Reliable and Scalable Robot Policy Evaluation with Imperfect Simulatorscited by 13
  22. 2025Real2Edit2Real: Generating Robotic Demonstrations via a 3D Control Interfacecited by 4
  23. 2025Fidelity-Aware Data Composition for Robust Robot Generalizationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SWEET: Sparse World Modeling with Image Editing for Embodied Task Execution
  2. 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training
  3. 2025Towards High-Consistency Embodied World Model with Multi-View Trajectory Videos
  4. 2026Masked Visual Actions for Unified World Modeling
  5. 2026GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actions
  6. 2025MoWM: Mixture-of-World-Models for Embodied Planning via Latent-to-Pixel Feature Modulation
  7. 2026DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulation
  8. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation