On the Efficiency of LoRA Fine-Tuning for Vision-Language-Action Models in Industrial Robotic Manipulation
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
Deploying billion-parameter Vision-Language-Action (VLA) models on industrial hardware requires fine-tuning to bridge the embodiment gap. Full Fine-Tuning (FFT) provides maximal plasticity but requires data centre-grade GPUs. We present a systematic study of Low-Rank Adaptation (LoRA) for π0, a flow-matching VLA, evaluated on four precision assembly tasks with a UR5e robotic manipulator. Across a sweep of LoRA ranks (r=8 to 256), allocation strategies, and component-freezing ablations, we find no statistically significant advantage of FFT over certain LoRA configurations. Performance saturates at r=32, and uniform allocation across the Vision-Language-Model (VLM) backbone and action expert proves sufficient. Freezing the VLM or restricting the vision encoder to LoRA significantly degrades performance, indicating that embodiment adaptation requires both semantic and visual plasticity. These results suggest that LoRA at r=32 with full vision encoder fine-tuning is a practical approach, reducing static peak VRAM from 36.2 to 10.8 GiB (parameters and optimizer states, activation memory excluded) without detectable performance loss.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 15 of its 26 references that are in the map. First posted on arXiv 11 Jul 2026.
Builds on
15 of 26 references.
Closest ancestors · 5
Same direction, newest first
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
- 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 10
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2023A Rank Stabilization Scaling Factor for Fine-Tuning with LoRAcited by 243
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 189
- 2026NeuroVLA: A Brain-inspired Embodied Intelligence for Fluid and Fast Reflexive Robotics Controlcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Towards Accessible Physical AI: LoRA-Based Fine-Tuning of VLA Models for Real-World Robot Control
- 2026Adaptive Capacity Allocation for Vision Language Action Fine-tuning
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success
- 2025Mechanistic Finetuning of Vision-Language-Action Models via Few-Shot Demonstrations
- 2026PhaseLoRA: Control-Regime-Conditioned Low-Rank Adaptation for Continuous-Action Vision-Language-Action Policies
- 2026VLA-GSE: Boosting Parameter-Efficient Fine-Tuning in VLA with Generalized and Specialized Experts
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think