KERV: Kinematic-Rectified Speculative Decoding for Embodied VLA Models
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action (VLA) models build a token-domain robot control paradigm, yet suffer from low speed. Speculative Decoding (SD) is an optimization strategy that can boost inference speed. Two key issues emerge when integrating VLA and SD: first, SD relies on re-inference to address token errors, which is computationally expensive; second, to mitigate token errors, the acceptance threshold in SD requires careful adjustment. Existing works fail to address the above two issues effectively. Meanwhile, as the bridge between AI and the physical world, existing embodied intelligence has overlooked the application of robotic kinematics. To address these issues, we innovatively combine token-domain VLA models with kinematic-domain prediction for SD, proposing a kinematic-rectified SD framework named KERV. We employ a kinematics-based Kalman Filter to predict actions and compensate for SD errors, avoiding costly re-inference. Moreover, we design a kinematics-based adjustment strategy to dynamically rectify the acceptance threshold, addressing the difficulty of threshold determination. Experimental results across diverse tasks and environments demonstrate that KERV achieves 27%~37% acceleration with nearly no Success Rate loss.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 20 of its 36 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
20 of 36 references.
Closest ancestors · 5
Same direction, newest first
- 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruning6 Sep
- 2025Spec-VLA: Speculative Decoding for Vision-Language-Action Models with Relaxed Acceptance30 Jul
- 2025CEED-VLA: Consistency Vision-Language-Action Model with Early-Exit Decoding16 Jun
- 2025MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation26 Mar
- 2024Quantization-Aware Imitation-Learning for Resource-Efficient Robotic Control2 Dec
Other references · 15
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
- 2024Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Headscited by 821
- 2024EAGLE: Speculative Sampling Requires Rethinking Feature Uncertaintycited by 564
- 2024EAGLE-2: Faster Inference of Language Models with Dynamic Draft Treescited by 362
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
- 2025EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Testcited by 318
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulationcited by 79
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026DyQ-VLA: Temporal-Dynamic-Aware Quantization for Embodied Vision-Language-Action Modelscited by 10
- 2026Realtime-VLA FLASH: Speculative Inference Framework for Diffusion-based VLAscited by 8
- 2026HeiSD: Hybrid Speculative Decoding for Embodied Vision-Language-Action Models with Kinematic Awarenesscited by 6
- 2026RAPID: Redundancy-Aware and Compatibility-Optimal Edge-Cloud Partitioned Inference for Diverse VLA Modelscited by 4
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inferencecited by 3
- 2026RoboECC: Multi-Factor-Aware Edge-Cloud Collaborative Deployment for VLA Modelscited by 2
- 20262D or 3D: Who Governs Salience in VLA Models? -- Tri-Stage Token Pruning Framework with Modality Salience Awarenesscited by 0
- 2026WA-SpecDec: World-Aware Speculative Decoding for Vision-Language-Action Modelscited by 0
- 2026Is Multimodal Speculative Decoding Ready for Diffusion-Based Parallel Drafting? A Survey and Empirical Diagnosiscited by 0
- 2026Is Multimodal Speculative Decoding Ready for Diffusion-Based Parallel Drafting? A Survey and Empirical Diagnosis21 Aug 2026
- 2026WA-SpecDec: World-Aware Speculative Decoding for Vision-Language-Action Models9 Aug 2026
- 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference14 Jul 2026
- 2026Realtime-VLA FLASH: Speculative Inference Framework for Diffusion-based VLAs13 May 2026
- 20262D or 3D: Who Governs Salience in VLA Models? -- Tri-Stage Token Pruning Framework with Modality Salience Awareness10 Apr 2026
- 2026RoboECC: Multi-Factor-Aware Edge-Cloud Collaborative Deployment for VLA Models21 Mar 2026
- 2026HeiSD: Hybrid Speculative Decoding for Embodied Vision-Language-Action Models with Kinematic Awareness18 Mar 2026
- 2026RAPID: Redundancy-Aware and Compatibility-Optimal Edge-Cloud Partitioned Inference for Diverse VLA Models9 Mar 2026
- 2026DyQ-VLA: Temporal-Dynamic-Aware Quantization for Embodied Vision-Language-Action Models9 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Algorithm-Architecture Co-Design for Efficient VLA Inference via Speculative Inference and Verification
- 2026PhysVLA: Towards Physically-Grounded VLA for Embodied Robotic Manipulation
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decoding
- 2026SA-VLA: State-aware tokenizer for improving Vision-Language-Action Models' performance
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
- 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
- 2026π0-EqM: Equilibrium Matching for Closed-Loop Vision-Language-Action Control
- 2026QVLA: Not All Channels Are Equal in Vision-Language-Action Model's Quantization