mlsanityData to 7 Oct 2026

DynamicVLA: A Vision-Language-Action Model for Dynamic Object Manipulation

arXiv 2601.22153 ↗First posted 29 Jan 2026cs.RO cs.CVcited by 33

On the map: Vision-language-action models → 3D and spatial-aware VLA

Abstract (arXiv)

Manipulating dynamic objects remains an open challenge for Vision-Language-Action (VLA) models. Although recent VLAs generalize well in static manipulation, dynamic scenes introduce a latency-induced perception-execution mismatch: object states continue to evolve during inference, making actions predicted from past observations stale at execution time. We present DynamicVLA, a latency-aware VLA model for dynamic object manipulation. It combines a compact 0.4B architecture and convolutional vision encoder for efficient multimodal inference with a continuous inference schedule that overlaps reasoning and execution for non-blocking control. Latent-aware Action Streaming then discards latency-invalid action prefixes and executes only the temporally valid suffix of each predicted chunk, preserving action-time alignment under dynamic object motion. To fill the missing foundation of dynamic manipulation data, we introduce the Dynamic Object Manipulation (DOM) benchmark, built with an automated collection pipeline that gathers 200K synthetic episodes across 2.8K scenes and 206 objects, and enables fast collection of 2K real-world episodes without teleoperation. Extensive evaluations in simulation and on real robots show that DynamicVLA improves dynamic manipulation success under changing object motion, perception-heavy instructions, and unseen motion patterns.

Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 51 of its 68 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

51 of 68 references.

References · 51

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  5. 2022Flow Matching for Generative Modelingcited by 5,426
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  9. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  10. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  11. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  12. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
38 more
  1. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  2. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  3. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  4. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  5. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  6. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  7. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  8. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  9. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  10. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  11. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
  12. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  13. 2023Learning Interactive Real-World Simulatorscited by 440
  14. 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
  15. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  16. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  17. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  18. 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 307
  19. 2025SmolVLM: Redefining small and efficient multimodal modelscited by 226
  20. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
  21. 2018RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitationcited by 202
  22. 2025Real-Time Execution of Action Chunking Flow Policiescited by 199
  23. 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
  24. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
  25. 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 161
  26. 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
  27. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 140
  28. 2019TossingBot: Learning to Throw Arbitrary Objects with Residual Physicscited by 131
  29. 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 117
  30. 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
  31. 2022VLMbench: A Compositional Benchmark for Vision-and-Language Manipulationcited by 68
  32. 2025VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inferencecited by 54
  33. 2025VideoWorld: Exploring Knowledge Learning from Unlabeled Videoscited by 42
  34. 2025Running VLAs at Real-time Speedcited by 42
  35. 2025Towards a Unified Understanding of Robot Manipulation: A Comprehensive Surveycited by 32
  36. 2024Achieving Human Level Competitive Robot Table Tenniscited by 24
  37. 20253D Scene Generation: A Surveycited by 24
  38. 2024TacSL: A Library for Visuotactile Sensor Simulation and Learningcited by 21

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 33.

33 papers.

Sort:

By area:

  1. 2026FASTER: Rethinking Real-Time Flow VLAscited by 20
  2. 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
  3. 2026πR2: Reactive Real-time Flow Policiescited by 4
  4. 2026Bridging Semantic and Kinematic Conditions with Diffusion-based Discrete Motion Tokenizercited by 3
  5. 2026DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executorscited by 3
  6. 2026DynamicWAM: Dual-Path Motion Conditioning for World-Action Models in Dynamic Manipulationcited by 3
  7. 2026HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactionscited by 2
  8. 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigationcited by 2
  9. 2026VLA-Pro: Cross-Task Procedural Memory Transfer for Vision-Language-Action Modelscited by 2
  10. 2026Acting While Understanding: Asynchronous Semantic-Action Decoupling for Real-Time Vision-Language-Action Modelscited by 2
  11. 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstrationcited by 2
  12. 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Modelscited by 1
21 more
  1. 2026PAMAE: Phase-Aware-MoE Action Experts Towards Reliable Flow-Matching Vision-Language-Action Policiescited by 1
  2. 2026Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulationcited by 1
  3. 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulationcited by 1
  4. 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Taskscited by 0
  5. 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulationcited by 0
  6. 2026DynaWM: A Base-VLA-Guided World Foundation Model for Moving-Object Manipulationcited by 0
  7. 2026ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Enginecited by 0
  8. 2026StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Modelscited by 0
  9. 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Modelscited by 0
  10. 2026Memory as Plans: World-Action Modeling with Memory-Grounded Planningcited by 0
  11. 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAscited by 0
  12. 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Modelscited by 0
  13. 2026React When You Need To: Event-Triggered Asynchronous Inference for VLA Policiescited by 0
  14. 2026Moving6DPoSe: A Multimodal Database for Monocular 6D Pose Estimation and Segmentation of Moving Objectscited by 0
  15. 2026DualManip: Agentic Dynamic Manipulation via Dual-Path Semantic Reasoning and Geometric Adaptationcited by 0
  16. 2026Dynamic Manipulation with World-Action Models via Counterfactual Planningcited by 0
  17. 2026RAVEL: Asynchronous Rolling Inference for Flow-Based Vision-Language-Action Modelscited by 0
  18. 2026D2-VLA: Dual-Memory Dual-Frequency Vision-Language-Action Model For Long Dynamic Manipulationcited by 0
  19. 2026LIBERO-MAX: Do Robot Policies Adapt When the World Changes?cited by 0
  20. 2026DSDyn-VLA: A Dual-Stream Dynamic Manipulation Framework with Motion Perception, Future Awareness, and Realtime Correctioncited by 0
  21. 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards Generalizable Robotic Manipulation in Dynamic Environments
  2. 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
  3. 2026DAM-VLA: A Dynamic Action Model-Based Vision-Language-Action Framework for Robot Manipulation
  4. 2026Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulation
  5. 2026ChainVLA: Chaining Vision-Language-Action Queries through a Unified Execution State for Long-Horizon Manipulation
  6. 2026BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation
  7. 2026Veo-Act: Enhancing VLA Policies with Frontier Video Models
  8. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey