FutureRTC: Real-Time Robot Execution with Anticipatory-Conditioned Action Chunking
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Real-time deployment of Vision-Language-Action (VLA) policies necessitates asynchronous execution, wherein subsequent action chunks are computed concurrently with the execution of the current chunk, leading to prediction-execution misalignment and manifesting as inter-chunk discontinuities. Existing methods either superficially smooth chunk boundaries, require costly policy optimization, or exclusively forward-predict proprioceptive states yet neglect critical visual observations. In this paper, we propose FutureRTC, a plug-and-play adaptation framework that predicts execution-time observations and states for asynchronous VLA control without modifying the underlying policy. Specifically, FutureRTC features a state correction module to compensate for the discrepancy between rolled-forward and actual execution-time proprioceptive states and an observation prediction module that forecasts execution-time visual representations by leveraging robot motion as an explicit physical prior through motion-aware feature transport and reconstruction. Furthermore, we introduce a policy consistency loss to align the action chunks generated from predicted contexts with those produced under the expected execution-time inputs of the VLA policy. Extensive experiments across simulated and real-world environments demonstrate that FutureRTC achieves superior robustness to inference delays, resulting in smoother trajectories, faster execution, and consistently higher task success rates.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 19 of its 25 references that are in the map. First posted on arXiv 27 Jul 2026.
Builds on
19 of 25 references.
Closest ancestors · 3
Same direction, newest first
- 2025Training-Time Action Conditioning for Efficient Real-Time Chunking5 Dec
- 2025VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inference30 Nov
- 2025Leave No Observation Behind: Real-time Correction for VLA Action Chunks27 Sep
Other references · 16
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 199
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
- 2026LeRobot: An Open-Source Library for End-to-End Robot Learningcited by 70
- 2024Real-World Robot Applications of Foundation Models: A Reviewcited by 60
- 2024Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Samplingcited by 46
4 more
- 2025Running VLAs at Real-time Speedcited by 42
- 2026Real-Time Robot Execution with Masked Action Chunkingcited by 16
- 2026Realtime-VLA V2: Learning to Run VLAs Fast, Smooth, and Accuratecited by 7
- 2026Start Right, Arrive Right: Asynchronous Execution via Initial Noise Selectioncited by 4
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
- 2026Reinforcement Learning for Real-Time Vision-Language-Action Policiescited by 0
- 2026CereVLA: Cerebellum-Inspired Consequence-Aware Residual Governance for Efficient Vision-Language-Action Executioncited by 0
- 2026Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulationcited by 0
- 2026Efficient World Action Model Inference with Adaptive Intermediate Statescited by 0
- 2026Revision, Not Restart: Revisable Visual Plans for Closed-Loop World-Action Modelscited by 0
- 2026From Local Whole-Body VLA Behaviors to Scene-Scale Aerial Manipulationcited by 0
- 2026Toward Real-Time VLAs: Stage-Aware Two-Step Flow Denoising and System-Level Evaluationcited by 0
- 2026Toward Real-Time VLAs: Stage-Aware Two-Step Flow Denoising and System-Level Evaluation30 Sep 2026
- 2026From Local Whole-Body VLA Behaviors to Scene-Scale Aerial Manipulation30 Sep 2026
- 2026Revision, Not Restart: Revisable Visual Plans for Closed-Loop World-Action Models28 Sep 2026
- 2026Efficient World Action Model Inference with Adaptive Intermediate States28 Sep 2026
- 2026Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulation24 Sep 2026
- 2026CereVLA: Cerebellum-Inspired Consequence-Aware Residual Governance for Efficient Vision-Language-Action Execution23 Sep 2026
- 2026Reinforcement Learning for Real-Time Vision-Language-Action Policies16 Sep 2026
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Action ControlNet: A Lightweight Delay-Aware Adapter for Smooth Asynchronous Control in Vision-Language-Action Models
- 2026VLA Knows Its Limits: Adaptive Execution Horizons for Robot Policies
- 2025VLA-RAIL: A Real-Time Asynchronous Inference Linker for VLA Models and Robots
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference
- 2026EvoScene-VLA: Evolving Scene Beliefs Inside the Action Decoder for Chunked Robot Control
- 2026DEFLECT: Temporal Counterfactual Preference Learning for Delay-Robust Asynchronous VLAs
- 2026PACE: Phase-Aware Chunk Execution for Robot Policies with Action Chunking
- 2026SEAM: Smooth Execution of Action-Chunked Motion for Vision-Language-Action Policies