# DynamicVLA: A Vision-Language-Action Model for Dynamic Object Manipulation

arXiv: https://arxiv.org/abs/2601.22153 · HTML: https://mlsanity.com/paper/2601.22153/

## Key facts

- Cited by 34 papers in the map (data through 14 Oct 2026).
- Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models.
- Builds on 51 of its 68 references that are in the map.
- First posted on arXiv 29 Jan 2026.

## Placed in

- Vision-language-action models / [3D and spatial-aware VLA](https://mlsanity.com/vla/3d-and-spatial-aware-vla/)

## Builds on (most cited first, 30 of 51)

- [GPT-4 Technical Report](https://mlsanity.com/paper/2303.08774/) (2023)
- [The Llama 3 Herd of Models](https://mlsanity.com/paper/2407.21783/) (2024)
- [Visual Instruction Tuning](https://mlsanity.com/paper/2304.08485/) (2023)
- [DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning](https://mlsanity.com/paper/2501.12948/) (2025)
- [Flow Matching for Generative Modeling](https://mlsanity.com/paper/2210.02747/) (2022)
- [Qwen2.5-VL Technical Report](https://mlsanity.com/paper/2502.13923/) (2025)
- [Improved Baselines with Visual Instruction Tuning](https://mlsanity.com/paper/2310.03744/) (2023)
- [Scaling Rectified Flow Transformers for High-Resolution Image Synthesis](https://mlsanity.com/paper/2403.03206/) (2024)
- [RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control](https://mlsanity.com/paper/2307.15818/) (2023)
- [OpenVLA: An Open-Source Vision-Language-Action Model](https://mlsanity.com/paper/2406.09246/) (2024)
- [Diffusion Policy: Visuomotor Policy Learning via Action Diffusion](https://mlsanity.com/paper/2303.04137/) (2023)
- [π0: A Vision-Language-Action Flow Model for General Robot Control](https://mlsanity.com/paper/2410.24164/) (2024)
- [RT-1: Robotics Transformer for Real-World Control at Scale](https://mlsanity.com/paper/2212.06817/) (2022)
- [π0.5: a Vision-Language-Action Model with Open-World Generalization](https://mlsanity.com/paper/2504.16054/) (2025)
- [Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware](https://mlsanity.com/paper/2304.13705/) (2023)
- [Objaverse: A Universe of Annotated 3D Objects](https://mlsanity.com/paper/2212.08051/) (2022)
- [Octo: An Open-Source Generalist Robot Policy](https://mlsanity.com/paper/2405.12213/) (2024)
- [LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning](https://mlsanity.com/paper/2306.03310/) (2023)
- [GR00T N1: An Open Foundation Model for Generalist Humanoid Robots](https://mlsanity.com/paper/2503.14734/) (2025)
- [Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success](https://mlsanity.com/paper/2502.19645/) (2025)
- [BridgeData V2: A Dataset for Robot Learning at Scale](https://mlsanity.com/paper/2308.12952/) (2023)
- [CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks](https://mlsanity.com/paper/2112.03227/) (2021)
- [SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics](https://mlsanity.com/paper/2506.01844/) (2025)
- [Evaluating Real-World Robot Manipulation Policies in Simulation](https://mlsanity.com/paper/2405.05941/) (2024)
- [Learning Interactive Real-World Simulators](https://mlsanity.com/paper/2310.06114/) (2023)
- [VIMA: General Robot Manipulation with Multimodal Prompts](https://mlsanity.com/paper/2210.03094/) (2022)
- [RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots](https://mlsanity.com/paper/2406.02523/) (2024)
- [3D-FRONT: 3D Furnished Rooms with layOuts and semaNTics](https://mlsanity.com/paper/2011.09127/) (2020)
- [Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulation](https://mlsanity.com/paper/2312.13139/) (2023)
- [SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model](https://mlsanity.com/paper/2502.02737/) (2025)

## Built on by (most cited first, 30 of 34)

- [FASTER: Rethinking Real-Time Flow VLAs](https://mlsanity.com/paper/2603.19199/) (2026)
- [MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction](https://mlsanity.com/paper/2603.19231/) (2026)
- [Bridging Semantic and Kinematic Conditions with Diffusion-based Discrete Motion Tokenizer](https://mlsanity.com/paper/2603.19227/) (2026)
- [DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executors](https://mlsanity.com/paper/2604.25050/) (2026)
- [πR2: Reactive Real-time Flow Policies](https://mlsanity.com/paper/2607.26055/) (2026)
- [DynamicWAM: Dual-Path Motion Conditioning for World-Action Models in Dynamic Manipulation](https://mlsanity.com/paper/2608.00793/) (2026)
- [ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Engine](https://mlsanity.com/paper/2607.28625/) (2026)
- [HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactions](https://mlsanity.com/paper/2603.15612/) (2026)
- [AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation](https://mlsanity.com/paper/2604.24086/) (2026)
- [VLA-Pro: Cross-Task Procedural Memory Transfer for Vision-Language-Action Models](https://mlsanity.com/paper/2605.29562/) (2026)
- [Acting While Understanding: Asynchronous Semantic-Action Decoupling for Real-Time Vision-Language-Action Models](https://mlsanity.com/paper/2606.15285/) (2026)
- [DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstration](https://mlsanity.com/paper/2608.01452/) (2026)
- [Memory as Plans: World-Action Modeling with Memory-Grounded Planning](https://mlsanity.com/paper/2609.11561/) (2026)
- [Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Models](https://mlsanity.com/paper/2605.11459/) (2026)
- [PAMAE: Phase-Aware-MoE Action Experts Towards Reliable Flow-Matching Vision-Language-Action Policies](https://mlsanity.com/paper/2606.27144/) (2026)
- [The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks](https://mlsanity.com/paper/2606.28529/) (2026)
- [Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulation](https://mlsanity.com/paper/2608.14379/) (2026)
- [TEMPO: Learning Temporal Context for Dynamic Robot Manipulation](https://mlsanity.com/paper/2609.16864/) (2026)
- [DualManip: Agentic Dynamic Manipulation via Dual-Path Semantic Reasoning and Geometric Adaptation](https://mlsanity.com/paper/2609.31112/) (2026)
- [PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulation](https://mlsanity.com/paper/2607.01938/) (2026)
- [DynaWM: A Base-VLA-Guided World Foundation Model for Moving-Object Manipulation](https://mlsanity.com/paper/2607.02604/) (2026)
- [StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models](https://mlsanity.com/paper/2608.26067/) (2026)
- [Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models](https://mlsanity.com/paper/2609.03927/) (2026)
- [Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAs](https://mlsanity.com/paper/2609.21022/) (2026)
- [KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Models](https://mlsanity.com/paper/2609.22335/) (2026)
- [React When You Need To: Event-Triggered Asynchronous Inference for VLA Policies](https://mlsanity.com/paper/2609.22587/) (2026)
- [Moving6DPoSe: A Multimodal Database for Monocular 6D Pose Estimation and Segmentation of Moving Objects](https://mlsanity.com/paper/2609.26161/) (2026)
- [Dynamic Manipulation with World-Action Models via Counterfactual Planning](https://mlsanity.com/paper/2609.33172/) (2026)
- [RAVEL: Asynchronous Rolling Inference for Flow-Based Vision-Language-Action Models](https://mlsanity.com/paper/2609.34170/) (2026)
- [D2-VLA: Dual-Memory Dual-Frequency Vision-Language-Action Model For Long Dynamic Manipulation](https://mlsanity.com/paper/2609.34792/) (2026)

## Abstract (arXiv)

Manipulating dynamic objects remains an open challenge for Vision-Language-Action (VLA) models. Although recent VLAs generalize well in static manipulation, dynamic scenes introduce a latency-induced perception-execution mismatch: object states continue to evolve during inference, making actions predicted from past observations stale at execution time. We present DynamicVLA, a latency-aware VLA model for dynamic object manipulation. It combines a compact 0.4B architecture and convolutional vision encoder for efficient multimodal inference with a continuous inference schedule that overlaps reasoning and execution for non-blocking control. Latent-aware Action Streaming then discards latency-invalid action prefixes and executes only the temporally valid suffix of each predicted chunk, preserving action-time alignment under dynamic object motion. To fill the missing foundation of dynamic manipulation data, we introduce the Dynamic Object Manipulation (DOM) benchmark, built with an automated collection pipeline that gathers 200K synthetic episodes across 2.8K scenes and 206 objects, and enables fast collection of 2K real-world episodes without teleoperation. Extensive evaluations in simulation and on real robots show that DynamicVLA improves dynamic manipulation success under changing object motion, perception-heavy instructions, and unseen motion patterns.
