BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulation
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Deploying powerful Vision-Language-Action (VLA) models on edge devices is limited by their massive size. In this paper, we take a deployment-oriented view of VLA training: we target efficiency through model design and optimization, rather than relying solely on post-hoc compression. Thus, we propose BitVLA, a fully native 1-bit VLA model for robotic manipulation, where every parameters is ternary, i.e., {-1,0,1}. BitVLA is built on the publicly available 1-bit LLM BitNet b1.58 2B4T, and is trained as a vision-language-action policy that inherits the compactness of 1-bit pretraining while retaining strong task performance. To further reduce the memory footprint of the vision backbone, we introduce Quantize-then-Distill, a post-training quantization-aware training strategy that compresses a full-precision vision encoder to 1.58-bit weights, while a full-precision teacher guides representation alignment during training. Across simulation benchmarks and real-world tasks, BitVLA matches the performance of the full-precision OpenVLA-OFT baseline, while reducing model memory by 11.0x and end-to-end latency by 4.4x. These results suggest a practical path toward training-time efficiency-accuracy co-design for embodied policies, enabling competitive manipulation capability on memory-constrained edge robotic platforms. We release the code in https://github.com/ustcwhy/BitVLA, model weights in https://huggingface.co/lxsy/bitvla-bf16.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 54 of its 61 references that are in the map. First posted on arXiv 9 Jun 2025.
Builds on
54 of 61 references.
References · 54
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2023Visual Instruction Tuningcited by 7,792
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
38 more
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 881
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2016A Diagram Is Worth A Dozen Imagescited by 793
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 692
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 344
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 315
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
- 2024The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bitscited by 289
- 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thoughtcited by 276
- 2024Reinforcement learningcited by 236
- 2023BitNet: Scaling 1-bit Transformers for Large Language Modelscited by 175
- 2024SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehensioncited by 144
- 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scalecited by 125
- 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 119
- 2024OneBit: Towards Extremely Low-bit Large Language Modelscited by 77
- 2023FP8-LM: Training FP8 Large Language Modelscited by 75
- 2023LLM-FP4: 4-Bit Floating-Point Quantized Transformerscited by 65
- 2023Training Transformers with 4-bit Integerscited by 58
- 2021PokeBNN: A Binary Pursuit of Lightweight Accuracycited by 48
- 2025BitNet b1.58 2B4T Technical Reportcited by 30
- 2024Scalable MatMul-free Language Modelingcited by 21
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2025: 11; 2026: 31.
42 papers.
Sort:
By area:
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 82
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 66
- 2025TGRPO :Fine-tuning Vision-Language-Action Model via Trajectory-wise Group Relative Policy Optimizationcited by 47
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 46
- 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Surveycited by 25
- 2025SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulationcited by 20
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 20
- 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulationcited by 19
- 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perfcited by 17
- 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Modelcited by 13
- 2025NanoVLA: Routing Decoupled Vision-Language Understanding for Nano-sized Generalist Robotic Policiescited by 12
30 more
- 2026DyQ-VLA: Temporal-Dynamic-Aware Quantization for Embodied Vision-Language-Action Modelscited by 10
- 2026Fast-dVLA: Accelerating Discrete Diffusion VLA to Real-Time Performancecited by 9
- 2026TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAMcited by 9
- 2025Survey of Vision-Language-Action Models for Embodied Manipulationcited by 7
- 2025ActionFlow: A Pipelined Action Acceleration for Vision Language Models on Edgecited by 6
- 2026TIDAL: Temporally Interleaved Diffusion and Action Loop for High-Frequency VLA Controlcited by 5
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
- 2026OxyGen: Unified KV Cache Management for VLA Inference under Multi-Task Parallelismcited by 4
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Modelscited by 4
- 2026Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulationcited by 4
- 2026ProbeFlow: Training-Free Adaptive Flow Matching for Vision-Language-Action Modelscited by 3
- 2026Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?cited by 3
- 2026FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inferencecited by 3
- 2026HBVLA: Pushing 1-Bit Post-Training Quantization for Vision-Language-Action Modelscited by 2
- 2026PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Modelscited by 2
- 2026Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptationcited by 2
- 2026Mini-BEHAVIOR-Gran: Revealing U-Shaped Effects of Instruction Granularity on Language-Guided Embodied Agentscited by 1
- 2026See Less, Specify More: Visual Evidence Budgets for Generalizable VLAscited by 1
- 2026Boosting Vision-Language-Action Finetuning with Feasible Action Neighborhood Priorcited by 0
- 2026CT-VAM: A Cerebello-Thalamic-Inspired Vision-Action Model for Efficient Visuomotor Controlcited by 0
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Taskscited by 0
- 2026FlashDrive: Flash Vision-Language-Action Inference for Autonomous Drivingcited by 0
- 2026Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerabilitycited by 0
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Modelscited by 0
- 2026GIFT: Goal-Injected Fine-Tuning for Efficient Manipulation Policy Adaptationcited by 0
- 2026vla.simd: Efficient CPU Inference for Language-Conditioned Manipulationcited by 0
- 2026VLAQuantBench: Closed-Loop Evaluation of Post-Training Quantization for Vision-Language-Action Modelscited by 0
- 2026Text-Vision Synergistic Token Caching: A Training-Free Framework for Efficient Vision-Language-Action Inferencecited by 0
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunkscited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Modelscited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Models8 Oct 2026
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunks29 Sep 2026
- 2026Text-Vision Synergistic Token Caching: A Training-Free Framework for Efficient Vision-Language-Action Inference28 Sep 2026
- 2026VLAQuantBench: Closed-Loop Evaluation of Post-Training Quantization for Vision-Language-Action Models21 Sep 2026
- 2026vla.simd: Efficient CPU Inference for Language-Conditioned Manipulation21 Sep 2026
- 2026GIFT: Goal-Injected Fine-Tuning for Efficient Manipulation Policy Adaptation7 Sep 2026
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models3 Sep 2026
- 2026FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference27 Aug 2026
- 2026Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability16 Aug 2026
- 2026FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving13 Aug 2026
- 2026TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM29 Jul 2026
- 2026Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulation8 Jul 2026
30 more
- 2026Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptation30 Jun 2026
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks26 Jun 2026
- 2026Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?26 Jun 2026
- 2026PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Models21 Jun 2026
- 2026CT-VAM: A Cerebello-Thalamic-Inspired Vision-Action Model for Efficient Visuomotor Control8 Jun 2026
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Models6 Jun 2026
- 2026See Less, Specify More: Visual Evidence Budgets for Generalizable VLAs1 Jun 2026
- 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Model14 May 2026
- 2026Mini-BEHAVIOR-Gran: Revealing U-Shaped Effects of Instruction Granularity on Language-Guided Embodied Agents18 Apr 2026
- 2026Boosting Vision-Language-Action Finetuning with Feasible Action Neighborhood Prior2 Apr 2026
- 2026Fast-dVLA: Accelerating Discrete Diffusion VLA to Real-Time Performance26 Mar 2026
- 2026FASTER: Rethinking Real-Time Flow VLAs19 Mar 2026
- 2026ProbeFlow: Training-Free Adaptive Flow Matching for Vision-Language-Action Models18 Mar 2026
- 2026OxyGen: Unified KV Cache Management for VLA Inference under Multi-Task Parallelism15 Mar 2026
- 2026DyQ-VLA: Temporal-Dynamic-Aware Quantization for Embodied Vision-Language-Action Models9 Mar 2026
- 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulation22 Feb 2026
- 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perf20 Feb 2026
- 2026HBVLA: Pushing 1-Bit Post-Training Quantization for Vision-Language-Action Models14 Feb 2026
- 2026TIDAL: Temporally Interleaved Diffusion and Action Loop for High-Frequency VLA Control21 Jan 2026
- 2025ActionFlow: A Pipelined Action Acceleration for Vision Language Models on Edge23 Dec 2025
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges12 Dec 2025
- 2025SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulation13 Nov 2025
- 2025NanoVLA: Routing Decoupled Vision-Language Understanding for Nano-sized Generalist Robotic Policies29 Oct 2025
- 2025A Survey on Efficient Vision-Language-Action Models27 Oct 2025
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey20 Oct 2025
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct 2025
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey23 Sep 2025
- 2025Survey of Vision-Language-Action Models for Embodied Manipulation21 Aug 2025
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey18 Aug 2025
- 2025TGRPO :Fine-tuning Vision-Language-Action Model via Trajectory-wise Group Relative Policy Optimization10 Jun 2025
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 66
- 2025TGRPO :Fine-tuning Vision-Language-Action Model via Trajectory-wise Group Relative Policy Optimizationcited by 47
- 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
- 2025SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulationcited by 20
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 20
- 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulationcited by 19
- 2026How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perfcited by 17
- 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Modelcited by 13
- 2026DyQ-VLA: Temporal-Dynamic-Aware Quantization for Embodied Vision-Language-Action Modelscited by 10
- 2026Fast-dVLA: Accelerating Discrete Diffusion VLA to Real-Time Performancecited by 9
- 2026TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAMcited by 9
- 2025Survey of Vision-Language-Action Models for Embodied Manipulationcited by 7
12 most cited of 28 All 28 (JSON)
- 2026Text-Vision Synergistic Token Caching: A Training-Free Framework for Efficient Vision-Language-Action Inference28 Sep 2026
- 2026VLAQuantBench: Closed-Loop Evaluation of Post-Training Quantization for Vision-Language-Action Models21 Sep 2026
- 2026GIFT: Goal-Injected Fine-Tuning for Efficient Manipulation Policy Adaptation7 Sep 2026
- 2026FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference27 Aug 2026
- 2026FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving13 Aug 2026
- 2026TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM29 Jul 2026
- 2026Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulation8 Jul 2026
- 2026Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?26 Jun 2026
- 2026PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Models21 Jun 2026
- 2026CT-VAM: A Cerebello-Thalamic-Inspired Vision-Action Model for Efficient Visuomotor Control8 Jun 2026
- 2026vla.cpp: A Unified Inference Runtime for Vision-Language-Action Models6 Jun 2026
- 2026See Less, Specify More: Visual Evidence Budgets for Generalizable VLAs1 Jun 2026
12 newest of 28 All 28 (JSON)
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 82
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 46
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Surveycited by 25
- 2025NanoVLA: Routing Decoupled Vision-Language Understanding for Nano-sized Generalist Robotic Policiescited by 12
- 2025ActionFlow: A Pipelined Action Acceleration for Vision Language Models on Edgecited by 6
- 2026Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptationcited by 2
- 2026Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptation30 Jun 2026
- 2025ActionFlow: A Pipelined Action Acceleration for Vision Language Models on Edge23 Dec 2025
- 2025NanoVLA: Routing Decoupled Vision-Language Understanding for Nano-sized Generalist Robotic Policies29 Oct 2025
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey20 Oct 2025
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct 2025
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey23 Sep 2025
- 2026Mini-BEHAVIOR-Gran: Revealing U-Shaped Effects of Instruction Granularity on Language-Guided Embodied Agentscited by 1
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Taskscited by 0
- 2026Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerabilitycited by 0
- 2026vla.simd: Efficient CPU Inference for Language-Conditioned Manipulationcited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Modelscited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Models8 Oct 2026
- 2026vla.simd: Efficient CPU Inference for Language-Conditioned Manipulation21 Sep 2026
- 2026Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability16 Aug 2026
- 2026The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks26 Jun 2026
- 2026Mini-BEHAVIOR-Gran: Revealing U-Shaped Effects of Instruction Granularity on Language-Guided Embodied Agents18 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026QVLA: Not All Channels Are Equal in Vision-Language-Action Model's Quantization
- 2025EdgeVLA: Efficient Vision-Language-Action Models
- 2026SimVLA: A Simple VLA Baseline for Robotic Manipulation
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decoding
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
- 2026RhinoVLA Technical Report
- 2026FoldQuantVLA: Native Low-Bit Quantization of Vision-Language-Action Models via Consistent Folding
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Model