Towards Accessible Physical AI: LoRA-Based Fine-Tuning of VLA Models for Real-World Robot Control
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
Vision-Language-Action (VLA) models have demonstrated remarkable capabilities in robotic manipulation,enabling robots to execute natural language commands through end-to-end learning from visual observations.However, deploying large-scale VLA models on affordable robotic platforms remains challenging due to computational constraints and the need for efficient adaptation to new robot embodiments. This paper presents an efficient fine-tuning methodology and real-world deployment analysis for adapting VLA models to low-cost robotic manipulation systems.We propose a resource-efficient fine-tuning strategy using Low-Rank Adaptation (LoRA) and quantization techniques that enable multi-billion parameter VLA models ( 3.1B parameters) to run on consumer-grade GPUs with 8GB VRAM. Our methodology addresses the critical challenge of adapting pre-trained VLA models to new robot embodiments with limited demonstration data, focusing on the trade-offs between frozen and unfrozen vision encoders. Through real-world deployment on the SO101 robotic arm for a button-pressing manipulation task, we demonstrate that our approach achieves effective manipulation performance while maintaining computational efficiency. We provide detailed analysis of deployment challenges, failure modes, and the relationship between training data quantity and real-world performance,trained on 200 demonstration episodes. Our results show that with proper fine-tuning methodology, VLA models can be successfully deployed on affordable robotic platforms,making advanced manipulation capabilities accessible beyond expensive research robots.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 8 of its 11 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
8 of 11 references.
Closest ancestors · 2
Same direction, newest first
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
Other references · 6
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 881
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026CORAL: Scalable Multi-Task Robot Learning via LoRA Expertscited by 8
- 2026Embodied Interpretability: Linking Causal Understanding to Generalization in Vision-Language-Action Modelscited by 2
- 2026VLA-GSE: Boosting Parameter-Efficient Fine-Tuning in VLA with Generalized and Specialized Expertscited by 1
- 2026VLA-GSE: Boosting Parameter-Efficient Fine-Tuning in VLA with Generalized and Specialized Experts7 May 2026
- 2026Embodied Interpretability: Linking Causal Understanding to Generalization in Vision-Language-Action Models1 May 2026
- 2026CORAL: Scalable Multi-Task Robot Learning via LoRA Experts10 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026On the Efficiency of LoRA Fine-Tuning for Vision-Language-Action Models in Industrial Robotic Manipulation
- 2026Adaptive Capacity Allocation for Vision Language Action Fine-tuning
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
- 2025ConRFT: A Reinforced Fine-tuning Method for VLA Models via Consistency Policy
- 2026A Pragmatic VLA Foundation Model
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey
- 2026Self-Adaptive VLA for Robust Robot Deployment