Leave No Observation Behind: Real-time Correction for VLA Action Chunks
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
To improve efficiency and temporal coherence, Vision-Language-Action (VLA) models often predict action chunks; however, this action chunking harms reactivity under inference delay and long horizons. We introduce Asynchronous Action Chunk Correction (A2C2), which is a lightweight real-time chunk correction head that runs every control step and adds a time-aware correction to any off-the-shelf VLA's action chunk. The module combines the latest observation, the predicted action from VLA (base action), a positional feature that encodes the index of the base action within the chunk, and some features from the base policy, then outputs a per-step correction. This preserves the base model's competence while restoring closed-loop responsiveness. The approach requires no retraining of the base policy and is orthogonal to asynchronous execution schemes such as Real Time Chunking (RTC). On the dynamic Kinetix task suite (12 tasks) and LIBERO Spatial, our method yields consistent success rate improvements across increasing delays and execution horizons (+23% point and +7% point respectively, compared to RTC), and also improves robustness for long horizons even with zero injected delay. Since the correction head is small and fast, there is minimal overhead compared to the inference of large VLA models. These results indicate that A2C2 is an effective, plug-in mechanism for deploying high-capacity chunking policies in real-time control.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 16 of its 27 references that are in the map. First posted on arXiv 27 Sep 2025.
Builds on
16 of 27 references.
References · 16
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2016Layer Normalizationcited by 5,579
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2018An Algorithmic Perspective on Imitation Learningcited by 455
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 199
- 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulationcited by 99
- 2024Real-World Robot Applications of Foundation Models: A Reviewcited by 60
4 more
- 2024Streaming Diffusion Policy: Fast Policy Synthesis with Variable Noise Diffusion Modelscited by 51
- 2024Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Samplingcited by 46
- 2024Kinetix: Investigating the Training of General Agents through Open-Ended Physics-Based Control Taskscited by 40
- 2025Streaming Flow Policy: Simplifying diffusion/flow-matching policies by treating action trajectories as flow trajectoriescited by 34
Built on by
Citing papers per year: 2025: 3; 2026: 42.
45 papers.
Sort:
By area:
- 2025Training-Time Action Conditioning for Efficient Real-Time Chunkingcited by 61
- 2025VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inferencecited by 54
- 2025VLA-RAIL: A Real-Time Asynchronous Inference Linker for VLA Models and Robotscited by 18
- 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perfcited by 17
- 2026VLA-Corrector: Lightweight Detect-and-Correct Inference for Adaptive Action Horizoncited by 14
- 2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistenciescited by 11
- 2026FutureRTC: Real-Time Robot Execution with Anticipatory-Conditioned Action Chunkingcited by 8
- 2026AsyncVLA: An Asynchronous VLA for Fast and Robust Navigation on the Edgecited by 7
- 2026DAM-VLA: Decoupled Asynchronous Multimodal Vision Language Action modelcited by 6
- 2026Open-Loop Planning, Closed-Loop Verification: Speculative Verification for VLAcited by 5
- 2026Adaptive Action Chunking via Multi-Chunk Q Value Estimationcited by 4
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Modelscited by 4
33 more
- 2026Understanding Asynchronous Inference Methods for Vision-Language-Action Modelscited by 3
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inferencecited by 3
- 2026Reflex: Real-Time VLA Control through Streaming Inferencecited by 3
- 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Executioncited by 3
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigationcited by 2
- 2026Acting While Understanding: Asynchronous Semantic-Action Decoupling for Real-Time Vision-Language-Action Modelscited by 2
- 2026DREAM-Chunk: Reactive Action Chunking with Latent World Modelcited by 2
- 2026Action ControlNet: A Lightweight Delay-Aware Adapter for Smooth Asynchronous Control in Vision-Language-Action Modelscited by 2
- 2026The Gate, Not the Cache: Gate Provenance Bounds the Closed-Loop Reliability of Training-Free VLA Token Skippingcited by 2
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstrationcited by 2
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Modelscited by 1
- 2026Elastic Queries Reinforcement Learning: Self-Aware Policy Execution for VLA Modelscited by 1
- 2026Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specializationcited by 1
- 2026Hermite Curves as Trajectory Priors for Vision-Language-Action Modelscited by 1
- 2026SC2-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environmentscited by 1
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulationcited by 1
- 2026ProbeAct: Probe-Guided Training-Free Failure Recovery in Vision-Language-Action Modelscited by 0
- 2026Real-Time Execution with Autoregressive Policiescited by 0
- 2026APEX: Adaptive Policy Execution for Precise Manipulationcited by 0
- 2026RAPAC-DP: Response-Aligned Pending-Action Compensation for Diffusion Policies under Delayed Executioncited by 0
- 2026GROOVE: Geometry-Guided Reduction of Operational-Space Jerk in VLA Executioncited by 0
- 2026Reinforcement Learning for Real-Time Vision-Language-Action Policiescited by 0
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAscited by 0
- 2026React When You Need To: Event-Triggered Asynchronous Inference for VLA Policiescited by 0
- 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinementcited by 0
- 2026Dynamic Manipulation with World-Action Models via Counterfactual Planningcited by 0
- 2026RAVEL: Asynchronous Rolling Inference for Flow-Based Vision-Language-Action Modelscited by 0
- 2026Action Chunking Proximal Policy Optimization with Feedback Correctioncited by 0
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunkscited by 0
- 2026Reactive Real-Time Flow Policies via Asynchronous Distribution Alignmentcited by 0
- 2026DSDyn-VLA: A Dual-Stream Dynamic Manipulation Framework with Motion Perception, Future Awareness, and Realtime Correctioncited by 0
- 2026Toward Real-Time VLAs: Stage-Aware Two-Step Flow Denoising and System-Level Evaluationcited by 0
- 2026Beyond LLM Serving: Characterizing Vision-Language-Action Workloads for Embodied AI System Designcited by 0
- 2026Beyond LLM Serving: Characterizing Vision-Language-Action Workloads for Embodied AI System Design4 Oct 2026
- 2026Toward Real-Time VLAs: Stage-Aware Two-Step Flow Denoising and System-Level Evaluation30 Sep 2026
- 2026DSDyn-VLA: A Dual-Stream Dynamic Manipulation Framework with Motion Perception, Future Awareness, and Realtime Correction30 Sep 2026
- 2026Reactive Real-Time Flow Policies via Asynchronous Distribution Alignment29 Sep 2026
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunks29 Sep 2026
- 2026Action Chunking Proximal Policy Optimization with Feedback Correction28 Sep 2026
- 2026RAVEL: Asynchronous Rolling Inference for Flow-Based Vision-Language-Action Models28 Sep 2026
- 2026Dynamic Manipulation with World-Action Models via Counterfactual Planning27 Sep 2026
- 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement21 Sep 2026
- 2026React When You Need To: Event-Triggered Asynchronous Inference for VLA Policies18 Sep 2026
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAs17 Sep 2026
- 2026Reinforcement Learning for Real-Time Vision-Language-Action Policies16 Sep 2026
33 more
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulation15 Sep 2026
- 2026GROOVE: Geometry-Guided Reduction of Operational-Space Jerk in VLA Execution12 Sep 2026
- 2026RAPAC-DP: Response-Aligned Pending-Action Compensation for Diffusion Policies under Delayed Execution16 Aug 2026
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstration2 Aug 2026
- 2026Hermite Curves as Trajectory Priors for Vision-Language-Action Models2 Aug 2026
- 2026SC2-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environments1 Aug 2026
- 2026Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specialization1 Aug 2026
- 2026The Gate, Not the Cache: Gate Provenance Bounds the Closed-Loop Reliability of Training-Free VLA Token Skipping1 Aug 2026
- 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution31 Jul 2026
- 2026FutureRTC: Real-Time Robot Execution with Anticipatory-Conditioned Action Chunking27 Jul 2026
- 2026Reflex: Real-Time VLA Control through Streaming Inference16 Jul 2026
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference14 Jul 2026
- 2026VLA-Corrector: Lightweight Detect-and-Correct Inference for Adaptive Action Horizon2 Jul 2026
- 2026Action ControlNet: A Lightweight Delay-Aware Adapter for Smooth Asynchronous Control in Vision-Language-Action Models24 Jun 2026
- 2026DREAM-Chunk: Reactive Action Chunking with Latent World Model17 Jun 2026
- 2026APEX: Adaptive Policy Execution for Precise Manipulation15 Jun 2026
- 2026Acting While Understanding: Asynchronous Semantic-Action Decoupling for Real-Time Vision-Language-Action Models13 Jun 2026
- 2026Elastic Queries Reinforcement Learning: Self-Aware Policy Execution for VLA Models12 Jun 2026
- 2026Real-Time Execution with Autoregressive Policies11 Jun 2026
- 2026DAM-VLA: Decoupled Asynchronous Multimodal Vision Language Action model10 Jun 2026
- 2026ProbeAct: Probe-Guided Training-Free Failure Recovery in Vision-Language-Action Models8 Jun 2026
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Models6 Jun 2026
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Models12 May 2026
- 2026Adaptive Action Chunking via Multi-Chunk Q Value Estimation11 May 2026
- 2026Understanding Asynchronous Inference Methods for Vision-Language-Action Models4 May 2026
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation27 Apr 2026
- 2026Open-Loop Planning, Closed-Loop Verification: Speculative Verification for VLA3 Apr 2026
- 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perf20 Feb 2026
- 2026AsyncVLA: An Asynchronous VLA for Fast and Robust Navigation on the Edge13 Feb 2026
- 2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistencies9 Feb 2026
- 2025VLA-RAIL: A Real-Time Asynchronous Inference Linker for VLA Models and Robots31 Dec 2025
- 2025Training-Time Action Conditioning for Efficient Real-Time Chunking5 Dec 2025
- 2025VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inference30 Nov 2025
- 2025Training-Time Action Conditioning for Efficient Real-Time Chunkingcited by 61
- 2025VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inferencecited by 54
- 2025VLA-RAIL: A Real-Time Asynchronous Inference Linker for VLA Models and Robotscited by 18
- 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perfcited by 17
- 2026VLA-Corrector: Lightweight Detect-and-Correct Inference for Adaptive Action Horizoncited by 14
- 2026FutureRTC: Real-Time Robot Execution with Anticipatory-Conditioned Action Chunkingcited by 8
- 2026Open-Loop Planning, Closed-Loop Verification: Speculative Verification for VLAcited by 5
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Modelscited by 4
- 2026Understanding Asynchronous Inference Methods for Vision-Language-Action Modelscited by 3
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inferencecited by 3
- 2026Reflex: Real-Time VLA Control through Streaming Inferencecited by 3
- 2026Acting While Understanding: Asynchronous Semantic-Action Decoupling for Real-Time Vision-Language-Action Modelscited by 2
12 most cited of 29 All 29 (JSON)
- 2026Beyond LLM Serving: Characterizing Vision-Language-Action Workloads for Embodied AI System Design4 Oct 2026
- 2026Toward Real-Time VLAs: Stage-Aware Two-Step Flow Denoising and System-Level Evaluation30 Sep 2026
- 2026DSDyn-VLA: A Dual-Stream Dynamic Manipulation Framework with Motion Perception, Future Awareness, and Realtime Correction30 Sep 2026
- 2026Reactive Real-Time Flow Policies via Asynchronous Distribution Alignment29 Sep 2026
- 2026RAVEL: Asynchronous Rolling Inference for Flow-Based Vision-Language-Action Models28 Sep 2026
- 2026React When You Need To: Event-Triggered Asynchronous Inference for VLA Policies18 Sep 2026
- 2026Reinforcement Learning for Real-Time Vision-Language-Action Policies16 Sep 2026
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulation15 Sep 2026
- 2026GROOVE: Geometry-Guided Reduction of Operational-Space Jerk in VLA Execution12 Sep 2026
- 2026Hermite Curves as Trajectory Priors for Vision-Language-Action Models2 Aug 2026
- 2026Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specialization1 Aug 2026
- 2026FutureRTC: Real-Time Robot Execution with Anticipatory-Conditioned Action Chunking27 Jul 2026
12 newest of 29 All 29 (JSON)
- 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Executioncited by 3
- 2026DREAM-Chunk: Reactive Action Chunking with Latent World Modelcited by 2
- 2026SC2-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environmentscited by 1
- 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinementcited by 0
- 2026Dynamic Manipulation with World-Action Models via Counterfactual Planningcited by 0
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunkscited by 0
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunks29 Sep 2026
- 2026Dynamic Manipulation with World-Action Models via Counterfactual Planning27 Sep 2026
- 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement21 Sep 2026
- 2026SC2-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environments1 Aug 2026
- 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution31 Jul 2026
- 2026DREAM-Chunk: Reactive Action Chunking with Latent World Model17 Jun 2026
- 2026Adaptive Action Chunking via Multi-Chunk Q Value Estimation11 May 2026
- 2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistenciescited by 11
- 2026AsyncVLA: An Asynchronous VLA for Fast and Robust Navigation on the Edgecited by 7
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigationcited by 2
- 2026The Gate, Not the Cache: Gate Provenance Bounds the Closed-Loop Reliability of Training-Free VLA Token Skippingcited by 2
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstrationcited by 2
- 2026Action Chunking Proximal Policy Optimization with Feedback Correctioncited by 0
- 2026Action Chunking Proximal Policy Optimization with Feedback Correction28 Sep 2026
- 2026DynamicManip: Enabling Dynamic Manipulation from a Single Static Demonstration2 Aug 2026
- 2026The Gate, Not the Cache: Gate Provenance Bounds the Closed-Loop Reliability of Training-Free VLA Token Skipping1 Aug 2026
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation27 Apr 2026
- 2026AsyncVLA: An Asynchronous VLA for Fast and Robust Navigation on the Edge13 Feb 2026
- 2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistencies9 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Learning Native Continuation for Action Chunking Flow Policies
- 2026Knowing When to Stop: Adaptive Action Chunking via Internal Cross-Attention Dynamics in VLAs
- 2026EvoScene-VLA: Evolving Scene Beliefs Inside the Action Decoder for Chunked Robot Control
- 2026FASTER: Rethinking Real-Time Flow VLAs
- 2026GeoAAC: Geometry-Based Adaptive Action Chunking from Denoising Trajectories in VLA Policies
- 2026Adaptive Action Chunking at Inference-time for Vision-Language-Action Models
- 2026VLA Knows Its Limits: Adaptive Execution Horizons for Robot Policies
- 2026FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference