VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inference
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action models (VLAs) are becoming increasingly capable across diverse robotic tasks. However, these models are typically deployed under synchronous inference, where the robot waits for model inference to complete before acting, and cannot perceive or respond to environmental changes during action execution. This not only introduces noticeable action stalls, but also significantly increases reaction latency, fundamentally limiting the applicability of VLAs to dynamic, real-time tasks. Asynchronous inference offers a promising solution to achieve continuous and low-latency control by enabling robots to execute actions and perform inference simultaneously. However, because the robot and environment continue to evolve during inference, a temporal misalignment arises between the prediction and execution intervals. This leads to significant action instability, while existing asynchronous methods either degrade accuracy or introduce runtime overhead to mitigate it. We propose VLASH, a simple yet effective method for asynchronous VLA inference that delivers smooth, accurate, and fast reaction control without architectural changes or additional runtime overhead. VLASH leverages the future execution-time state by rolling the robot state forward with the previous action chunk, thereby bridging the gap between prediction and execution. Experiments show that VLASH reduces reaction latency by up to 11.8x compared to synchronous inference and consistently outperforms all asynchronous baselines in accuracy. With action quantization, it further achieves 1.5-2.0x task completion speedup with minimal accuracy loss. Moreover, it empowers state-of-the-art VLAs such as π0.5 to handle fast-reaction, high-precision tasks including playing ping-pong and playing whack-a-mole, where traditional synchronous inference fails. Code is available at https://github.com/mit-han-lab/vlash
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 24 of its 39 references that are in the map. First posted on arXiv 30 Nov 2025.
Builds on
24 of 39 references.
Closest ancestors · 2
Same direction, newest first
- 2025Leave No Observation Behind: Real-time Correction for VLA Action Chunks27 Sep
- 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruning16 Sep
Other references · 22
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2022SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Modelscited by 1,338
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
10 more
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 199
- 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 180
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 142
- 2025Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfercited by 86
- 2025Running VLAs at Real-time Speedcited by 42
- 2024Kinetix: Investigating the Training of General Agents through Open-Ended Physics-Based Control Taskscited by 40
- 2025HITTER: A HumanoId Table TEnnis Robot via Hierarchical Planning and Learningcited by 29
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Surveycited by 25
- 2025DemoSpeedup: Accelerating Visuomotor Policies via Entropy-Guided Demonstration Accelerationcited by 13
Built on by
Citing papers per year: 2025: 2; 2026: 52.
54 papers.
Sort:
By area:
- 2026Causal World Modeling for Robot Controlcited by 289
- 2025Training-Time Action Conditioning for Efficient Real-Time Chunkingcited by 61
- 2026Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Executioncited by 42
- 2026DynamicVLA: A Vision-Language-Action Model for Dynamic Object Manipulationcited by 33
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 20
- 2026Hy-Embodied-0.5-VLA: From Vision-Language-Action Models to a Real-World Robot Learning Stackcited by 20
- 2025VLA-RAIL: A Real-Time Asynchronous Inference Linker for VLA Models and Robotscited by 18
- 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perfcited by 17
- 2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistenciescited by 11
- 2026Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulationcited by 9
- 2026FutureRTC: Real-Time Robot Execution with Anticipatory-Conditioned Action Chunkingcited by 8
- 2026AsyncVLA: An Asynchronous VLA for Fast and Robust Navigation on the Edgecited by 7
38 more
- 2026StreamingVLA: Streaming Vision-Language-Action Model with Action Flow Matching and Adaptive Early Observationcited by 6
- 2026DAM-VLA: Decoupled Asynchronous Multimodal Vision Language Action modelcited by 6
- 2026TIDAL: Temporally Interleaved Diffusion and Action Loop for High-Frequency VLA Controlcited by 5
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Modelcited by 5
- 2026πR2: Reactive Real-time Flow Policiescited by 4
- 2026Speedup Patch: Learning a Plug-and-Play Policy to Accelerate Embodied Manipulationcited by 3
- 2026DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executorscited by 3
- 2026Understanding Asynchronous Inference Methods for Vision-Language-Action Modelscited by 3
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inferencecited by 3
- 2026Reflex: Real-Time VLA Control through Streaming Inferencecited by 3
- 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Executioncited by 3
- 2026FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inferencecited by 3
- 2026Offload or Overload: A Platform Measurement Study of Mobile Robotic Manipulation Workloadscited by 2
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigationcited by 2
- 2026Acting While Understanding: Asynchronous Semantic-Action Decoupling for Real-Time Vision-Language-Action Modelscited by 2
- 2026DREAM-Chunk: Reactive Action Chunking with Latent World Modelcited by 2
- 2026Action ControlNet: A Lightweight Delay-Aware Adapter for Smooth Asynchronous Control in Vision-Language-Action Modelscited by 2
- 2026The Gate, Not the Cache: Gate Provenance Bounds the Closed-Loop Reliability of Training-Free VLA Token Skippingcited by 2
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstrationcited by 2
- 2026Elastic Queries Reinforcement Learning: Self-Aware Policy Execution for VLA Modelscited by 1
- 2026Reducing Temporal Redundancy for Efficient Vision-Language-Action Inferencecited by 1
- 2026Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specializationcited by 1
- 2026Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulationcited by 1
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulationcited by 1
- 2026DexPIE: Stable Dexterous Policy Improvement from Real-World Experiencecited by 0
- 2026Real-Time Execution with Autoregressive Policiescited by 0
- 2026LAGO Policy: Latency-Aware Asynchronous Diffusion Policies with Goal-Directed Collision-Free Planning for Smooth Manipulationcited by 0
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Taskscited by 0
- 2026EcoVLA: Energy-Efficient Device-Edge Co-Inference for Vision-Language-Action Models under Real-Time Constraintscited by 0
- 2026RAPAC-DP: Response-Aligned Pending-Action Compensation for Diffusion Policies under Delayed Executioncited by 0
- 2026Reinforcement Learning for Real-Time Vision-Language-Action Policiescited by 0
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAscited by 0
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Modelscited by 0
- 2026React When You Need To: Event-Triggered Asynchronous Inference for VLA Policiescited by 0
- 2026Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulationcited by 0
- 2026RAVEL: Asynchronous Rolling Inference for Flow-Based Vision-Language-Action Modelscited by 0
- 2026Zero-Shot Reactive Obstacle Avoidance for Generative Robot Policiescited by 0
- 2026Reactive Real-Time Flow Policies via Asynchronous Distribution Alignmentcited by 0
50 most cited of 54 All 54 (JSON)
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Models8 Oct 2026
- 2026Beyond LLM Serving: Characterizing Vision-Language-Action Workloads for Embodied AI System Design4 Oct 2026
- 2026Toward Real-Time VLAs: Stage-Aware Two-Step Flow Denoising and System-Level Evaluation30 Sep 2026
- 2026DSDyn-VLA: A Dual-Stream Dynamic Manipulation Framework with Motion Perception, Future Awareness, and Realtime Correction30 Sep 2026
- 2026Reactive Real-Time Flow Policies via Asynchronous Distribution Alignment29 Sep 2026
- 2026Zero-Shot Reactive Obstacle Avoidance for Generative Robot Policies28 Sep 2026
- 2026RAVEL: Asynchronous Rolling Inference for Flow-Based Vision-Language-Action Models28 Sep 2026
- 2026Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulation24 Sep 2026
- 2026React When You Need To: Event-Triggered Asynchronous Inference for VLA Policies18 Sep 2026
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAs17 Sep 2026
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Models16 Sep 2026
- 2026Reinforcement Learning for Real-Time Vision-Language-Action Policies16 Sep 2026
38 more
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulation15 Sep 2026
- 2026FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference27 Aug 2026
- 2026RAPAC-DP: Response-Aligned Pending-Action Compensation for Diffusion Policies under Delayed Execution16 Aug 2026
- 2026EcoVLA: Energy-Efficient Device-Edge Co-Inference for Vision-Language-Action Models under Real-Time Constraints16 Aug 2026
- 2026Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulation14 Aug 2026
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstration2 Aug 2026
- 2026Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specialization1 Aug 2026
- 2026The Gate, Not the Cache: Gate Provenance Bounds the Closed-Loop Reliability of Training-Free VLA Token Skipping1 Aug 2026
- 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution31 Jul 2026
- 2026πR2: Reactive Real-time Flow Policies28 Jul 2026
- 2026FutureRTC: Real-Time Robot Execution with Anticipatory-Conditioned Action Chunking27 Jul 2026
- 2026Reflex: Real-Time VLA Control through Streaming Inference16 Jul 2026
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference14 Jul 2026
- 2026Reducing Temporal Redundancy for Efficient Vision-Language-Action Inference14 Jul 2026
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks26 Jun 2026
- 2026Action ControlNet: A Lightweight Delay-Aware Adapter for Smooth Asynchronous Control in Vision-Language-Action Models24 Jun 2026
- 2026DREAM-Chunk: Reactive Action Chunking with Latent World Model17 Jun 2026
- 2026LAGO Policy: Latency-Aware Asynchronous Diffusion Policies with Goal-Directed Collision-Free Planning for Smooth Manipulation16 Jun 2026
- 2026Acting While Understanding: Asynchronous Semantic-Action Decoupling for Real-Time Vision-Language-Action Models13 Jun 2026
- 2026Hy-Embodied-0.5-VLA: From Vision-Language-Action Models to a Real-World Robot Learning Stack12 Jun 2026
- 2026Elastic Queries Reinforcement Learning: Self-Aware Policy Execution for VLA Models12 Jun 2026
- 2026Real-Time Execution with Autoregressive Policies11 Jun 2026
- 2026DAM-VLA: Decoupled Asynchronous Multimodal Vision Language Action model10 Jun 2026
- 2026DexPIE: Stable Dexterous Policy Improvement from Real-World Experience8 Jun 2026
- 2026Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulation1 Jun 2026
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Model12 May 2026
- 2026Understanding Asynchronous Inference Methods for Vision-Language-Action Models4 May 2026
- 2026DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executors27 Apr 2026
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation27 Apr 2026
- 2026StreamingVLA: Streaming Vision-Language-Action Model with Action Flow Matching and Adaptive Early Observation30 Mar 2026
- 2026Speedup Patch: Learning a Plug-and-Play Policy to Accelerate Embodied Manipulation21 Mar 2026
- 2026FASTER: Rethinking Real-Time Flow VLAs19 Mar 2026
- 2026Offload or Overload: A Platform Measurement Study of Mobile Robotic Manipulation Workloads18 Mar 2026
- 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perf20 Feb 2026
- 2026AsyncVLA: An Asynchronous VLA for Fast and Robust Navigation on the Edge13 Feb 2026
- 2026Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Execution13 Feb 2026
- 2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistencies9 Feb 2026
- 2026DynamicVLA: A Vision-Language-Action Model for Dynamic Object Manipulation29 Jan 2026
50 newest of 54 All 54 (JSON)
- 2025Training-Time Action Conditioning for Efficient Real-Time Chunkingcited by 61
- 2026Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Executioncited by 42
- 2026DynamicVLA: A Vision-Language-Action Model for Dynamic Object Manipulationcited by 33
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 20
- 2026Hy-Embodied-0.5-VLA: From Vision-Language-Action Models to a Real-World Robot Learning Stackcited by 20
- 2025VLA-RAIL: A Real-Time Asynchronous Inference Linker for VLA Models and Robotscited by 18
- 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perfcited by 17
- 2026FutureRTC: Real-Time Robot Execution with Anticipatory-Conditioned Action Chunkingcited by 8
- 2026StreamingVLA: Streaming Vision-Language-Action Model with Action Flow Matching and Adaptive Early Observationcited by 6
- 2026TIDAL: Temporally Interleaved Diffusion and Action Loop for High-Frequency VLA Controlcited by 5
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Modelcited by 5
- 2026Understanding Asynchronous Inference Methods for Vision-Language-Action Modelscited by 3
12 most cited of 32 All 32 (JSON)
- 2026Beyond LLM Serving: Characterizing Vision-Language-Action Workloads for Embodied AI System Design4 Oct 2026
- 2026Toward Real-Time VLAs: Stage-Aware Two-Step Flow Denoising and System-Level Evaluation30 Sep 2026
- 2026DSDyn-VLA: A Dual-Stream Dynamic Manipulation Framework with Motion Perception, Future Awareness, and Realtime Correction30 Sep 2026
- 2026Reactive Real-Time Flow Policies via Asynchronous Distribution Alignment29 Sep 2026
- 2026RAVEL: Asynchronous Rolling Inference for Flow-Based Vision-Language-Action Models28 Sep 2026
- 2026React When You Need To: Event-Triggered Asynchronous Inference for VLA Policies18 Sep 2026
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Models16 Sep 2026
- 2026Reinforcement Learning for Real-Time Vision-Language-Action Policies16 Sep 2026
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulation15 Sep 2026
- 2026FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference27 Aug 2026
- 2026EcoVLA: Energy-Efficient Device-Edge Co-Inference for Vision-Language-Action Models under Real-Time Constraints16 Aug 2026
- 2026Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulation14 Aug 2026
12 newest of 32 All 32 (JSON)
- 2026Causal World Modeling for Robot Controlcited by 289
- 2026Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulationcited by 9
- 2026Speedup Patch: Learning a Plug-and-Play Policy to Accelerate Embodied Manipulationcited by 3
- 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Executioncited by 3
- 2026DREAM-Chunk: Reactive Action Chunking with Latent World Modelcited by 2
- 2026Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulationcited by 0
- 2026Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulation24 Sep 2026
- 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution31 Jul 2026
- 2026DREAM-Chunk: Reactive Action Chunking with Latent World Model17 Jun 2026
- 2026Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulation1 Jun 2026
- 2026Speedup Patch: Learning a Plug-and-Play Policy to Accelerate Embodied Manipulation21 Mar 2026
- 2026Causal World Modeling for Robot Control29 Jan 2026
- 2026DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executorscited by 3
- 2026LAGO Policy: Latency-Aware Asynchronous Diffusion Policies with Goal-Directed Collision-Free Planning for Smooth Manipulationcited by 0
- 2026RAPAC-DP: Response-Aligned Pending-Action Compensation for Diffusion Policies under Delayed Executioncited by 0
- 2026Zero-Shot Reactive Obstacle Avoidance for Generative Robot Policiescited by 0
- 2026Zero-Shot Reactive Obstacle Avoidance for Generative Robot Policies28 Sep 2026
- 2026RAPAC-DP: Response-Aligned Pending-Action Compensation for Diffusion Policies under Delayed Execution16 Aug 2026
- 2026LAGO Policy: Latency-Aware Asynchronous Diffusion Policies with Goal-Directed Collision-Free Planning for Smooth Manipulation16 Jun 2026
- 2026DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executors27 Apr 2026
- 2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistenciescited by 11
- 2026AsyncVLA: An Asynchronous VLA for Fast and Robust Navigation on the Edgecited by 7
- 2026πR2: Reactive Real-time Flow Policiescited by 4
- 2026Offload or Overload: A Platform Measurement Study of Mobile Robotic Manipulation Workloadscited by 2
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigationcited by 2
- 2026The Gate, Not the Cache: Gate Provenance Bounds the Closed-Loop Reliability of Training-Free VLA Token Skippingcited by 2
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstrationcited by 2
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Taskscited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Modelscited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Models8 Oct 2026
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstration2 Aug 2026
- 2026The Gate, Not the Cache: Gate Provenance Bounds the Closed-Loop Reliability of Training-Free VLA Token Skipping1 Aug 2026
- 2026πR2: Reactive Real-time Flow Policies28 Jul 2026
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks26 Jun 2026
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation27 Apr 2026
- 2026Offload or Overload: A Platform Measurement Study of Mobile Robotic Manipulation Workloads18 Mar 2026
- 2026AsyncVLA: An Asynchronous VLA for Fast and Robust Navigation on the Edge13 Feb 2026
- 2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistencies9 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Model
- 2026ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models
- 2025SITCOM: Scaling Inference-Time COMpute for VLAs
- 2026ActionGround: Training-Free Runtime Refinement of Frozen VLA Policies
- 2026Retrieve-then-Steer: Online Success Memory for Test-Time Adaptation of Generative VLAs
- 2025AsyncVLA: Asynchronous Flow Matching for Vision-Language-Action Models
- 2025ActionFlow: A Pipelined Action Acceleration for Vision Language Models on Edge
- 2026DEFLECT: Temporal Counterfactual Preference Learning for Delay-Robust Asynchronous VLAs