mlsanityData to 7 Oct 2026

ContactFlow: A video action conditioning that transfers across embodiments

arXiv 2607.26579 ↗First posted 29 Jul 2026cs.RO cs.CVcited by 0

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World models offer a promising route toward robot planning by enabling agents to imagine and verify the consequences of actions before execution. However, current video-based world models often struggle to capture the physical constraints that govern manipulation, particularly contact. Further, their action conditioning is often constrained to specific embodiments such as parallel grippers. We propose Contact Flow, an embodiment-agnostic action representation that encodes manipulation through the trajectory of 3D contact points between an actor and a target object. By discarding actor-specific appearance and kinematics, Contact Flow provides a shared conditioning signal for both human demonstrations and robotic execution. Therefore, we can train a large-scale video generative model on both human and robotic object interaction videos conditioned on Contact Flow, yielding a world model that predicts physically plausible manipulation outcomes. We integrate this model into a propose-imagine-verify-act pipeline, where generated rollouts are assessed by a vision-language model before execution. Experiments on the DROID dataset and real-world tabletop manipulation tasks demonstrate that Contact Flow enables transfer between human demonstrations and different robotic embodiments.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 55 of its 59 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

55 of 59 references.

Closest ancestors · 10

Same direction, newest first

  1. 2026Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation17 Mar
  2. 2026Interactive World Simulator for Robot Policy Training and Evaluation9 Mar
  3. 2026BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Masks3 Feb
  4. 2025STORM: Search-Guided Generative World Models for Robotic Manipulation20 Dec
  5. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
  6. 20253DFlowAction: Learning Cross-Embodiment Manipulation from 3D Flow World Model6 Jun
  7. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
  8. 2025TesserAct: Learning 4D Embodied World Models29 Apr
  9. 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
  10. 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr

Other references · 45

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  6. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  7. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  8. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  9. 2025VACE: All-in-One Video Creation and Editingcited by 467
  10. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  11. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
  12. 2023Reconstructing Hands in 3D with Transformerscited by 298
33 more
  1. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  2. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 279
  3. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
  4. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
  5. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  6. 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 213
  7. 2023Any-point Trajectory Modeling for Policy Learningcited by 207
  8. 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 180
  9. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
  10. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
  11. 2023Video Language Planningcited by 160
  12. 2025Do generative video models understand physical principles?cited by 151
  13. 2019ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imagingcited by 145
  14. 2021ContactOpt: Optimizing Contact to Improve Graspscited by 137
  15. 2024Flow as the Cross-Domain Manipulation Interfacecited by 126
  16. 2025Video Generators are Robot Policiescited by 86
  17. 2024TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understandingcited by 85
  18. 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 84
  19. 2024OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completioncited by 78
  20. 2022Global Planning for Contact-Rich Manipulation via Local Smoothing of Quasi-dynamic Contact Modelscited by 46
  21. 2025RoboEngine: Plug-and-Play Robot Data Augmentation with Semantic Robot Segmentation and Background Generationcited by 40
  22. 2025FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesiscited by 37
  23. 2025TASTE-Rob: Advancing Video Generation of Task-Oriented Hand-Object Interaction for Generalizable Robotic Manipulationcited by 24
  24. 2024OnlyFlow: Optical Flow based Motion Conditioning for Video Diffusion Modelscited by 15
  25. 2025Precise Action-to-Video Generation Through Visual Action Promptscited by 15
  26. 2025Object-centric 3D Motion Field for Robot Learning from Human Videoscited by 13
  27. 2025Learning Dense Hand Contact Estimation from Imbalanced Datacited by 12
  28. 2026RoboInter: A Holistic Intermediate Representation Suite Towards Robotic Manipulationcited by 12
  29. 2024InterDyn: Controllable Interactive Dynamics with Video Diffusion Modelscited by 11
  30. 2025Mask2IV: Interaction-Centric Video Generation via Mask Trajectoriescited by 10
  31. 2025EgoControl: Controllable Egocentric Video Generation via 3D Full-Body Posescited by 7
  32. 2025Open-world Hand-Object Interaction Video Generation Based on Structure and Contact-aware Representationcited by 5
  33. 2025DRAW2ACT: Turning Depth-Encoded Trajectories into Robotic Demonstration Videoscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025EC-Flow: Enabling Versatile Robotic Manipulation from Action-Unlabeled Videos via Embodiment-Centric Flow
  2. 2026UMR: Universal Manipulation Representation ↗
  3. 2025Joint Flow Trajectory Optimization For Feasible Robot Motion Generation from Video Demonstrations
  4. 2026From a Single Demonstration to a General Policy for Contact-Rich Manipulation
  5. 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
  6. 2026Flow-Enabled Generalization to Human Demonstrations in Few-Shot Imitation Learning
  7. 2026RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic Manipulation
  8. 2025ManiFlow: A General Robot Manipulation Policy via Consistency Flow Training