Text-Vision Synergistic Token Caching: A Training-Free Framework for Efficient Vision-Language-Action Inference
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action (VLA) models enable generalizable robotic control but remain computationally expensive. Token caching provides a training-free, plug-and-play acceleration alternative. However, existing VLA caching does not fully exploit a key inductive bias of VLA models: text-vision synergy, wherein textual semantics guide the precise visual grounding of task-relevant regions. In particular, existing designs insufficiently account for head-wise reliability in attention aggregation and layer-wise stability in cache reuse. To address this, we propose Text-Vision Synergistic Token Caching (TVCache), a training-free framework for efficient VLA inference. TVCache filters attention heads based on text-vision information focus to improve task-relevant and physically consistent visual grounding. Concurrently, we introduce a reuse-layer selection mechanism guided by text-vision entropy differences to avoid caching unstable representations and improve cache resource allocation. Extensive experiments across four representative VLA models, two simulation benchmarks, and real-world robotic tasks demonstrate the effectiveness and generality of TVCache. At matched token-retention ratios, TVCache consistently improves task success over existing VLA caching with comparable computational cost. On OpenVLA-OFT, it improves average success by up to 14.5 percentage points over VLA-Cache at 12.5% retention while reducing FLOPs by 2.45x relative to full-token inference.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 26 of its 30 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
26 of 30 references.
Closest ancestors · 7
Same direction, newest first
- 2026DyQ-VLA: Temporal-Dynamic-Aware Quantization for Embodied Vision-Language-Action Models9 Mar
- 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perf20 Feb
- 2026QVLA: Not All Channels Are Equal in Vision-Language-Action Model's Quantization3 Feb
- 2025CEED-VLA: Consistency Vision-Language-Action Model with Early-Exit Decoding16 Jun
- 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models11 Jun
- 2025BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulation9 Jun
- 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Caching4 Feb
Other references · 19
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 629
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 378
7 more
- 2025DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Modelscited by 177
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 140
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 116
- 2024vid-TLDR: Training Free Token merging for Light-weight Video Transformercited by 41
- 2025Similarity-Aware Token Pruning: Your VLM but Fastercited by 32
- 2025SwiftVLA: Unlocking Spatiotemporal Dynamics for Lightweight VLA Models at Minimal Overheadcited by 23
- 2025DeeAD: Dynamic Early Exit of Vision-Language Action for Efficient Autonomous Drivingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
- 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
- 2026Beyond Attention Magnitude: Leveraging Inter-layer Rank Consistency for Efficient Vision-Language-Action Models
- 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inference
- 2025Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Models
- 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruning
- 2026ActionCache: Training-Free Acceleration for Vision-Language-Action Models with Action Caching and Refinement
- 2026Neural Introspection Gating for Adaptive KV-Cache Reuse in Vision-Language-Action Models