DynamicVLA: A Vision-Language-Action Model for Dynamic Object Manipulation
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
Manipulating dynamic objects remains an open challenge for Vision-Language-Action (VLA) models. Although recent VLAs generalize well in static manipulation, dynamic scenes introduce a latency-induced perception-execution mismatch: object states continue to evolve during inference, making actions predicted from past observations stale at execution time. We present DynamicVLA, a latency-aware VLA model for dynamic object manipulation. It combines a compact 0.4B architecture and convolutional vision encoder for efficient multimodal inference with a continuous inference schedule that overlaps reasoning and execution for non-blocking control. Latent-aware Action Streaming then discards latency-invalid action prefixes and executes only the temporally valid suffix of each predicted chunk, preserving action-time alignment under dynamic object motion. To fill the missing foundation of dynamic manipulation data, we introduce the Dynamic Object Manipulation (DOM) benchmark, built with an automated collection pipeline that gathers 200K synthetic episodes across 2.8K scenes and 206 objects, and enables fast collection of 2K real-world episodes without teleoperation. Extensive evaluations in simulation and on real robots show that DynamicVLA improves dynamic manipulation success under changing object motion, perception-heavy instructions, and unseen motion patterns.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 51 of its 68 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
51 of 68 references.
References · 51
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Visual Instruction Tuningcited by 7,792
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
38 more
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2023Learning Interactive Real-World Simulatorscited by 440
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 307
- 2025SmolVLM: Redefining small and efficient multimodal modelscited by 226
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
- 2018RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitationcited by 202
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 199
- 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 161
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 140
- 2019TossingBot: Learning to Throw Arbitrary Objects with Residual Physicscited by 131
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 117
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
- 2022VLMbench: A Compositional Benchmark for Vision-and-Language Manipulationcited by 68
- 2025VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inferencecited by 54
- 2025VideoWorld: Exploring Knowledge Learning from Unlabeled Videoscited by 42
- 2025Running VLAs at Real-time Speedcited by 42
- 2025Towards a Unified Understanding of Robot Manipulation: A Comprehensive Surveycited by 32
- 2024Achieving Human Level Competitive Robot Table Tenniscited by 24
- 20253D Scene Generation: A Surveycited by 24
- 2024TacSL: A Library for Visuotactile Sensor Simulation and Learningcited by 21
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 33.
33 papers.
Sort:
By area:
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 20
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
- 2026πR2: Reactive Real-time Flow Policiescited by 4
- 2026Bridging Semantic and Kinematic Conditions with Diffusion-based Discrete Motion Tokenizercited by 3
- 2026DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executorscited by 3
- 2026DynamicWAM: Dual-Path Motion Conditioning for World-Action Models in Dynamic Manipulationcited by 3
- 2026HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactionscited by 2
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigationcited by 2
- 2026VLA-Pro: Cross-Task Procedural Memory Transfer for Vision-Language-Action Modelscited by 2
- 2026Acting While Understanding: Asynchronous Semantic-Action Decoupling for Real-Time Vision-Language-Action Modelscited by 2
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstrationcited by 2
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Modelscited by 1
21 more
- 2026PAMAE: Phase-Aware-MoE Action Experts Towards Reliable Flow-Matching Vision-Language-Action Policiescited by 1
- 2026Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulationcited by 1
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulationcited by 1
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Taskscited by 0
- 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulationcited by 0
- 2026DynaWM: A Base-VLA-Guided World Foundation Model for Moving-Object Manipulationcited by 0
- 2026ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Enginecited by 0
- 2026StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Modelscited by 0
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Modelscited by 0
- 2026Memory as Plans: World-Action Modeling with Memory-Grounded Planningcited by 0
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAscited by 0
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Modelscited by 0
- 2026React When You Need To: Event-Triggered Asynchronous Inference for VLA Policiescited by 0
- 2026Moving6DPoSe: A Multimodal Database for Monocular 6D Pose Estimation and Segmentation of Moving Objectscited by 0
- 2026DualManip: Agentic Dynamic Manipulation via Dual-Path Semantic Reasoning and Geometric Adaptationcited by 0
- 2026Dynamic Manipulation with World-Action Models via Counterfactual Planningcited by 0
- 2026RAVEL: Asynchronous Rolling Inference for Flow-Based Vision-Language-Action Modelscited by 0
- 2026D2-VLA: Dual-Memory Dual-Frequency Vision-Language-Action Model For Long Dynamic Manipulationcited by 0
- 2026LIBERO-MAX: Do Robot Policies Adapt When the World Changes?cited by 0
- 2026DSDyn-VLA: A Dual-Stream Dynamic Manipulation Framework with Motion Perception, Future Awareness, and Realtime Correctioncited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Modelscited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Models8 Oct 2026
- 2026DSDyn-VLA: A Dual-Stream Dynamic Manipulation Framework with Motion Perception, Future Awareness, and Realtime Correction30 Sep 2026
- 2026LIBERO-MAX: Do Robot Policies Adapt When the World Changes?29 Sep 2026
- 2026D2-VLA: Dual-Memory Dual-Frequency Vision-Language-Action Model For Long Dynamic Manipulation28 Sep 2026
- 2026RAVEL: Asynchronous Rolling Inference for Flow-Based Vision-Language-Action Models28 Sep 2026
- 2026Dynamic Manipulation with World-Action Models via Counterfactual Planning27 Sep 2026
- 2026DualManip: Agentic Dynamic Manipulation via Dual-Path Semantic Reasoning and Geometric Adaptation25 Sep 2026
- 2026React When You Need To: Event-Triggered Asynchronous Inference for VLA Policies18 Sep 2026
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAs17 Sep 2026
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Models16 Sep 2026
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulation15 Sep 2026
- 2026Memory as Plans: World-Action Modeling with Memory-Grounded Planning10 Sep 2026
21 more
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models3 Sep 2026
- 2026StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models26 Aug 2026
- 2026Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulation14 Aug 2026
- 2026Moving6DPoSe: A Multimodal Database for Monocular 6D Pose Estimation and Segmentation of Moving Objects9 Aug 2026
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstration2 Aug 2026
- 2026DynamicWAM: Dual-Path Motion Conditioning for World-Action Models in Dynamic Manipulation1 Aug 2026
- 2026ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Engine30 Jul 2026
- 2026πR2: Reactive Real-time Flow Policies28 Jul 2026
- 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulation2 Jul 2026
- 2026DynaWM: A Base-VLA-Guided World Foundation Model for Moving-Object Manipulation1 Jul 2026
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks26 Jun 2026
- 2026PAMAE: Phase-Aware-MoE Action Experts Towards Reliable Flow-Matching Vision-Language-Action Policies25 Jun 2026
- 2026Acting While Understanding: Asynchronous Semantic-Action Decoupling for Real-Time Vision-Language-Action Models13 Jun 2026
- 2026VLA-Pro: Cross-Task Procedural Memory Transfer for Vision-Language-Action Models28 May 2026
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Models12 May 2026
- 2026DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executors27 Apr 2026
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation27 Apr 2026
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction19 Mar 2026
- 2026Bridging Semantic and Kinematic Conditions with Diffusion-based Discrete Motion Tokenizer19 Mar 2026
- 2026FASTER: Rethinking Real-Time Flow VLAs19 Mar 2026
- 2026HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactions16 Mar 2026
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 20
- 2026VLA-Pro: Cross-Task Procedural Memory Transfer for Vision-Language-Action Modelscited by 2
- 2026Acting While Understanding: Asynchronous Semantic-Action Decoupling for Real-Time Vision-Language-Action Modelscited by 2
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Modelscited by 1
- 2026PAMAE: Phase-Aware-MoE Action Experts Towards Reliable Flow-Matching Vision-Language-Action Policiescited by 1
- 2026Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulationcited by 1
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulationcited by 1
- 2026DynaWM: A Base-VLA-Guided World Foundation Model for Moving-Object Manipulationcited by 0
- 2026StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Modelscited by 0
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Modelscited by 0
- 2026React When You Need To: Event-Triggered Asynchronous Inference for VLA Policiescited by 0
- 2026RAVEL: Asynchronous Rolling Inference for Flow-Based Vision-Language-Action Modelscited by 0
12 most cited of 14 All 14 (JSON)
- 2026DSDyn-VLA: A Dual-Stream Dynamic Manipulation Framework with Motion Perception, Future Awareness, and Realtime Correction30 Sep 2026
- 2026D2-VLA: Dual-Memory Dual-Frequency Vision-Language-Action Model For Long Dynamic Manipulation28 Sep 2026
- 2026RAVEL: Asynchronous Rolling Inference for Flow-Based Vision-Language-Action Models28 Sep 2026
- 2026React When You Need To: Event-Triggered Asynchronous Inference for VLA Policies18 Sep 2026
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Models16 Sep 2026
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulation15 Sep 2026
- 2026StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models26 Aug 2026
- 2026Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulation14 Aug 2026
- 2026DynaWM: A Base-VLA-Guided World Foundation Model for Moving-Object Manipulation1 Jul 2026
- 2026PAMAE: Phase-Aware-MoE Action Experts Towards Reliable Flow-Matching Vision-Language-Action Policies25 Jun 2026
- 2026Acting While Understanding: Asynchronous Semantic-Action Decoupling for Real-Time Vision-Language-Action Models13 Jun 2026
- 2026VLA-Pro: Cross-Task Procedural Memory Transfer for Vision-Language-Action Models28 May 2026
12 newest of 14 All 14 (JSON)
- 2026DynamicWAM: Dual-Path Motion Conditioning for World-Action Models in Dynamic Manipulationcited by 3
- 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulationcited by 0
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Modelscited by 0
- 2026Memory as Plans: World-Action Modeling with Memory-Grounded Planningcited by 0
- 2026Dynamic Manipulation with World-Action Models via Counterfactual Planningcited by 0
- 2026Dynamic Manipulation with World-Action Models via Counterfactual Planning27 Sep 2026
- 2026Memory as Plans: World-Action Modeling with Memory-Grounded Planning10 Sep 2026
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models3 Sep 2026
- 2026DynamicWAM: Dual-Path Motion Conditioning for World-Action Models in Dynamic Manipulation1 Aug 2026
- 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulation2 Jul 2026
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
- 2026πR2: Reactive Real-time Flow Policiescited by 4
- 2026HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactionscited by 2
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigationcited by 2
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstrationcited by 2
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Taskscited by 0
- 2026ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Enginecited by 0
- 2026Moving6DPoSe: A Multimodal Database for Monocular 6D Pose Estimation and Segmentation of Moving Objectscited by 0
- 2026LIBERO-MAX: Do Robot Policies Adapt When the World Changes?cited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Modelscited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Models8 Oct 2026
- 2026LIBERO-MAX: Do Robot Policies Adapt When the World Changes?29 Sep 2026
- 2026Moving6DPoSe: A Multimodal Database for Monocular 6D Pose Estimation and Segmentation of Moving Objects9 Aug 2026
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstration2 Aug 2026
- 2026ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Engine30 Jul 2026
- 2026πR2: Reactive Real-time Flow Policies28 Jul 2026
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks26 Jun 2026
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation27 Apr 2026
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction19 Mar 2026
- 2026HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactions16 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Towards Generalizable Robotic Manipulation in Dynamic Environments
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2026DAM-VLA: A Dynamic Action Model-Based Vision-Language-Action Framework for Robot Manipulation
- 2026Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulation
- 2026ChainVLA: Chaining Vision-Language-Action Queries through a Unified Execution State for Long-Horizon Manipulation
- 2026BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation
- 2026Veo-Act: Enhancing VLA Policies with Frontier Video Models
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey