Robotic VLA Benefits from Joint Learning with Motion Image Diffusion
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action (VLA) models have achieved remarkable progress in robotic manipulation by mapping multimodal observations and instructions directly to actions. However, they typically mimic expert trajectories without predictive motion reasoning, which limits their ability to reason about what actions to take. To address this limitation, we propose joint learning with motion image diffusion, a novel strategy that enhances VLA models with motion reasoning capabilities. Our method extends the VLA architecture with a dual-head design: while the action head predicts action chunks as in vanilla VLAs, an additional motion head, implemented as a Diffusion Transformer (DiT), predicts optical-flow-based motion images that capture future dynamics. The two heads are trained jointly, enabling the shared VLM backbone to learn representations that couple robot control with motion knowledge. This joint learning builds temporally coherent and physically grounded representations without modifying the inference pathway of standard VLAs, thereby maintaining test-time latency. Experiments in both simulation and real-world environments demonstrate that joint learning with motion image diffusion improves the success rate of pi-series VLAs to 97.5% on the LIBERO benchmark and 58.0% on the RoboTwin benchmark, yielding a 23% improvement in real-world performance and validating its effectiveness in enhancing the motion reasoning capability of large-scale VLAs.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 73 of its 77 references that are in the map. First posted on arXiv 19 Dec 2025.
Builds on
73 of 77 references.
Closest ancestors · 2
Same direction, newest first
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model13 Mar
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan
Other references · 71
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Visual Instruction Tuningcited by 7,792
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023Qwen Technical Reportcited by 3,273
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
38 more
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
- 2024Latent Action Pretraining from Videoscited by 302
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
- 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 218
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
- 2023Any-point Trajectory Modeling for Policy Learningcited by 207
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2025Unified Video Action Modelcited by 195
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
- 2023Learning to Act from Actionless Videos through Dense Correspondencescited by 159
- 2023Structured World Models from Human Videoscited by 144
- 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 142
- 2025Magma: A Foundation Model for Multimodal AI Agentscited by 138
- 2025Unified Vision-Language-Action Modelcited by 128
50 most cited of 71 All 71 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026LaMP: Learning Vision-Language-Action Policy with 3D Scene Flow as Latent Motion Priorcited by 11
- 2026FlowWAM: Optical Flow as a Unified Action Representation for World Action Modelscited by 10
- 2026DynamicWAM: Dual-Path Motion Conditioning for World-Action Models in Dynamic Manipulationcited by 3
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Modelscited by 1
- 2026GeoProp: Grounding Robot State in Vision for Generalist Manipulationcited by 1
- 2026World Tokens: Enhancing Embodied Policies with Training-Time World Modelingcited by 1
- 2026IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Trainingcited by 1
- 2026IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Training31 Aug 2026
- 2026World Tokens: Enhancing Embodied Policies with Training-Time World Modeling10 Aug 2026
- 2026DynamicWAM: Dual-Path Motion Conditioning for World-Action Models in Dynamic Manipulation1 Aug 2026
- 2026FlowWAM: Optical Flow as a Unified Action Representation for World Action Models14 Jul 2026
- 2026GeoProp: Grounding Robot State in Vision for Generalist Manipulation8 Jul 2026
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Models12 May 2026
- 2026LaMP: Learning Vision-Language-Action Policy with 3D Scene Flow as Latent Motion Prior26 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025E0: Enhancing Generalization and Fine-Grained Control in VLA Models via Tweedie Discrete Diffusion
- 2026Learning Action Priors for Cross-embodiment Robot Manipulation
- 2026Two Bridges, One Pathway: From VLMs to Generalizable VLAs with Embodied Trajectory-Coupled Data
- 2025dVLA: Diffusion Vision-Language-Action Model with Multimodal Chain-of-Thought
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control
- 2026V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models
- 2026MMaDA-VLA: Large Diffusion Vision-Language-Action Model with Unified Multi-Modal Instruction and Generation
- 2025cVLA: Towards Efficient Camera-Space VLAs