ContactFlow: A video action conditioning that transfers across embodiments
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World models offer a promising route toward robot planning by enabling agents to imagine and verify the consequences of actions before execution. However, current video-based world models often struggle to capture the physical constraints that govern manipulation, particularly contact. Further, their action conditioning is often constrained to specific embodiments such as parallel grippers. We propose Contact Flow, an embodiment-agnostic action representation that encodes manipulation through the trajectory of 3D contact points between an actor and a target object. By discarding actor-specific appearance and kinematics, Contact Flow provides a shared conditioning signal for both human demonstrations and robotic execution. Therefore, we can train a large-scale video generative model on both human and robotic object interaction videos conditioned on Contact Flow, yielding a world model that predicts physically plausible manipulation outcomes. We integrate this model into a propose-imagine-verify-act pipeline, where generated rollouts are assessed by a vision-language model before execution. Experiments on the DROID dataset and real-world tabletop manipulation tasks demonstrate that Contact Flow enables transfer between human demonstrations and different robotic embodiments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 55 of its 59 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
55 of 59 references.
Closest ancestors · 10
Same direction, newest first
- 2026Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation17 Mar
- 2026Interactive World Simulator for Robot Policy Training and Evaluation9 Mar
- 2026BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Masks3 Feb
- 2025STORM: Search-Guided Generative World Models for Robotic Manipulation20 Dec
- 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
- 20253DFlowAction: Learning Cross-Embodiment Manipulation from 3D Flow World Model6 Jun
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
- 2025TesserAct: Learning 4D Embodied World Models29 Apr
- 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
- 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr
Other references · 45
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
- 2023Reconstructing Hands in 3D with Transformerscited by 298
33 more
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 279
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 213
- 2023Any-point Trajectory Modeling for Policy Learningcited by 207
- 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 180
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2023Video Language Planningcited by 160
- 2025Do generative video models understand physical principles?cited by 151
- 2019ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imagingcited by 145
- 2021ContactOpt: Optimizing Contact to Improve Graspscited by 137
- 2024Flow as the Cross-Domain Manipulation Interfacecited by 126
- 2025Video Generators are Robot Policiescited by 86
- 2024TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understandingcited by 85
- 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 84
- 2024OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completioncited by 78
- 2022Global Planning for Contact-Rich Manipulation via Local Smoothing of Quasi-dynamic Contact Modelscited by 46
- 2025RoboEngine: Plug-and-Play Robot Data Augmentation with Semantic Robot Segmentation and Background Generationcited by 40
- 2025FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesiscited by 37
- 2025TASTE-Rob: Advancing Video Generation of Task-Oriented Hand-Object Interaction for Generalizable Robotic Manipulationcited by 24
- 2024OnlyFlow: Optical Flow based Motion Conditioning for Video Diffusion Modelscited by 15
- 2025Precise Action-to-Video Generation Through Visual Action Promptscited by 15
- 2025Object-centric 3D Motion Field for Robot Learning from Human Videoscited by 13
- 2025Learning Dense Hand Contact Estimation from Imbalanced Datacited by 12
- 2026RoboInter: A Holistic Intermediate Representation Suite Towards Robotic Manipulationcited by 12
- 2024InterDyn: Controllable Interactive Dynamics with Video Diffusion Modelscited by 11
- 2025Mask2IV: Interaction-Centric Video Generation via Mask Trajectoriescited by 10
- 2025EgoControl: Controllable Egocentric Video Generation via 3D Full-Body Posescited by 7
- 2025Open-world Hand-Object Interaction Video Generation Based on Structure and Contact-aware Representationcited by 5
- 2025DRAW2ACT: Turning Depth-Encoded Trajectories into Robotic Demonstration Videoscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025EC-Flow: Enabling Versatile Robotic Manipulation from Action-Unlabeled Videos via Embodiment-Centric Flow
- 2026UMR: Universal Manipulation Representation ↗
- 2025Joint Flow Trajectory Optimization For Feasible Robot Motion Generation from Video Demonstrations
- 2026From a Single Demonstration to a General Policy for Contact-Rich Manipulation
- 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
- 2026Flow-Enabled Generalization to Human Demonstrations in Few-Shot Imitation Learning
- 2026RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic Manipulation
- 2025ManiFlow: A General Robot Manipulation Policy via Consistency Flow Training