FASTer: Toward Efficient Autoregressive Vision Language Action Modeling via Neural Action Tokenization
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Autoregressive vision-language-action (VLA) models have recently demonstrated strong capabilities in robotic manipulation. However, their core process of action tokenization often involves a trade-off between reconstruction fidelity and inference efficiency. We introduce FASTer, a unified framework for efficient and generalizable robot learning that integrates a learnable tokenizer with an autoregressive policy built upon it. FASTerVQ encodes action chunks as single-channel images, capturing global spatio-temporal dependencies while maintaining a high compression ratio. FASTerVLA builds on this tokenizer with block-wise autoregressive decoding and a lightweight action expert, achieving both faster inference and higher task performance. Extensive experiments across simulated and real-world benchmarks show that FASTerVQ delivers superior reconstruction quality, high token utilization, and strong cross-task and cross-embodiment generalization, while FASTerVLA further improves overall capability, surpassing previous state-of-the-art VLA models in both inference speed and task performance.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 61 of its 67 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
61 of 67 references.
Closest ancestors · 3
Same direction, newest first
- 2025VQ-VLA: Improving Vision-Language-Action Models via Scaling Vector-Quantized Action Tokenizers1 Jul
- 2025Conditioning Matters: Training Diffusion Policies is Faster Than You Think16 May
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan
Other references · 58
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Visual Instruction Tuningcited by 7,792
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2017Neural Discrete Representation Learningcited by 4,650
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
38 more
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 730
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 385
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
- 2022MAGVIT: Masked Generative Video Transformercited by 341
- 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 295
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
- 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
- 2022More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsitycited by 142
- 2024OmniTokenizer: A Joint Image-Video Tokenizer for Visual Generationcited by 117
- 2024Image and Video Tokenization with Binary Spherical Quantizationcited by 110
- 2025Galaxea Open-World Dataset and G0 Dual-System VLA Modelcited by 90
- 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 87
- 2023SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Modelscited by 85
- 2025Actions as Language: Fine-Tuning VLMs into VLAs Without Catastrophic Forgettingcited by 52
- 2024Scaling Transformers for Low-Bitrate High-Quality Speech Codingcited by 48
- 2024VidTok: A Versatile and Open-Source Video Tokenizercited by 35
- 2025Flow to the Mode: Mode-Seeking Diffusion Autoencoders for State-of-the-Art Image Tokenizationcited by 35
- 2025VLA-OS: Structuring and Dissecting Planning Representations and Paradigms in Vision-Language-Action Modelscited by 34
- 2024Autoregressive Action Sequence Learning for Robotic Manipulationcited by 26
- 2025BEAST: Efficient Tokenization of B-Splines Encoded Action Sequences for Imitation Learningcited by 25
- 2025XY-Tokenizer: Mitigating the Semantic-Acoustic Conflict in Low-Bitrate Speech Codecscited by 21
- 2024Learning Graph Quantized Tokenizerscited by 19
- 2024Low Frame-rate Speech Codec: a Codec Designed for Fast High-quality Speech LLM Training and Inferencecited by 11
- 2024GLAD: Improving Latent Graph Generative Modeling with Simple Quantizationcited by 8
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 20.
21 papers.
Sort:
By area:
- 2026CLAP: Contrastive Latent Action Pretraining for Learning Vision-Language-Action Models from Human Videoscited by 27
- 2026LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transfercited by 17
- 2026ActionCodec: What Makes for Good Action Tokenizerscited by 17
- 2026Wall-OSS-0.5 Technical Reportcited by 11
- 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-trainingcited by 7
- 2026AR-VLA: True Autoregressive Action Expert for Vision-Language-Action Modelscited by 6
- 2026X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretrainingcited by 6
- 2026Mimic Intent, Not Just Trajectoriescited by 5
- 2026DFM-VLA: Iterative Action Refinement for Robot Manipulation via Discrete Flow Matchingcited by 5
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulationcited by 4
- 2026Coarse-to-Control: Action-Token Planning for Vision-Language-Action Modelscited by 3
- 2026Reflex: Real-Time VLA Control through Streaming Inferencecited by 3
9 more
- 2026Robots Need More than VLA and World Modelscited by 2
- 2026Towards Predictive, Aligned, and Scalable Robot Learningcited by 2
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Modelscited by 1
- 2026Real-Time Execution with Autoregressive Policiescited by 0
- 2026ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Modelscited by 0
- 2026CARE: Experience-Guided Atomic Corrective Execution for Vision-Language-Action Policiescited by 0
- 2026Rethinking Causal Action Tokenization with Conditional Annealing in Flow Matchingcited by 0
- 2026Humanoid Loco-Manipulation With Discrete VLA Modelcited by 0
- 2026SplineWAM: Adaptive Action Horizons for World Action Models via B-Spline Representationscited by 0
- 2026SplineWAM: Adaptive Action Horizons for World Action Models via B-Spline Representations30 Sep 2026
- 2026Humanoid Loco-Manipulation With Discrete VLA Model28 Sep 2026
- 2026Rethinking Causal Action Tokenization with Conditional Annealing in Flow Matching28 Sep 2026
- 2026CARE: Experience-Guided Atomic Corrective Execution for Vision-Language-Action Policies21 Sep 2026
- 2026ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models16 Sep 2026
- 2026Reflex: Real-Time VLA Control through Streaming Inference16 Jul 2026
- 2026Towards Predictive, Aligned, and Scalable Robot Learning13 Jul 2026
- 2026Real-Time Execution with Autoregressive Policies11 Jun 2026
- 2026X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretraining7 Jun 2026
- 2026Coarse-to-Control: Action-Token Planning for Vision-Language-Action Models5 Jun 2026
- 2026Robots Need More than VLA and World Models4 Jun 2026
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation2 Jun 2026
9 more
- 2026Wall-OSS-0.5 Technical Report29 May 2026
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Models12 May 2026
- 2026DFM-VLA: Iterative Action Refinement for Robot Manipulation via Discrete Flow Matching27 Mar 2026
- 2026AR-VLA: True Autoregressive Action Expert for Vision-Language-Action Models10 Mar 2026
- 2026ActionCodec: What Makes for Good Action Tokenizers17 Feb 2026
- 2026LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transfer11 Feb 2026
- 2026Mimic Intent, Not Just Trajectories9 Feb 2026
- 2026CLAP: Contrastive Latent Action Pretraining for Learning Vision-Language-Action Models from Human Videos7 Jan 2026
- 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training30 Dec 2025
- 2026CLAP: Contrastive Latent Action Pretraining for Learning Vision-Language-Action Models from Human Videoscited by 27
- 2026LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transfercited by 17
- 2026Wall-OSS-0.5 Technical Reportcited by 11
- 2026AR-VLA: True Autoregressive Action Expert for Vision-Language-Action Modelscited by 6
- 2026X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretrainingcited by 6
- 2026Mimic Intent, Not Just Trajectoriescited by 5
- 2026DFM-VLA: Iterative Action Refinement for Robot Manipulation via Discrete Flow Matchingcited by 5
- 2026Coarse-to-Control: Action-Token Planning for Vision-Language-Action Modelscited by 3
- 2026Reflex: Real-Time VLA Control through Streaming Inferencecited by 3
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Modelscited by 1
- 2026Real-Time Execution with Autoregressive Policiescited by 0
- 2026ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Modelscited by 0
12 most cited of 15 All 15 (JSON)
- 2026Humanoid Loco-Manipulation With Discrete VLA Model28 Sep 2026
- 2026Rethinking Causal Action Tokenization with Conditional Annealing in Flow Matching28 Sep 2026
- 2026CARE: Experience-Guided Atomic Corrective Execution for Vision-Language-Action Policies21 Sep 2026
- 2026ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models16 Sep 2026
- 2026Reflex: Real-Time VLA Control through Streaming Inference16 Jul 2026
- 2026Real-Time Execution with Autoregressive Policies11 Jun 2026
- 2026X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretraining7 Jun 2026
- 2026Coarse-to-Control: Action-Token Planning for Vision-Language-Action Models5 Jun 2026
- 2026Wall-OSS-0.5 Technical Report29 May 2026
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Models12 May 2026
- 2026DFM-VLA: Iterative Action Refinement for Robot Manipulation via Discrete Flow Matching27 Mar 2026
- 2026AR-VLA: True Autoregressive Action Expert for Vision-Language-Action Models10 Mar 2026
12 newest of 15 All 15 (JSON)
- 2026ActionCodec: What Makes for Good Action Tokenizerscited by 17
- 2026ActionCodec: What Makes for Good Action Tokenizers17 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decoding
- 2026Reducing Temporal Redundancy for Efficient Vision-Language-Action Inference
- 2026G0.5: One Autoregressive Stream for Robot Reasoning and Action
- 2026Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Model
- 2026FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference
- 2026LoopVLA: Learning Sufficiency in Recurrent Refinement for Vision-Language-Action Models