Semi-Supervised Vision-Language-Action Model
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
Vision-Language-Action (VLA) models enable robots to predict actions directly from visual observations and language instructions, but adapting them to new environments still depends on costly action-labeled demonstrations. To reduce this dependence, we study semi-supervised VLA adaptation under limited supervision signals, where only a small portion of trajectories contain robot actions and the remaining trajectories provide action-unlabeled vision-language observations. Unlike standard semi-supervised learning, the missing supervision is an embodied action signal that must be visually grounded, language-consistent, physically feasible, and temporally stable. To address this problem, we propose SemiVLA, a self-distilled teacher-student framework that learns from reliable pseudo-actions on unlabeled trajectories. SemiVLA introduces a VLA-specific reliability controller to assess vision-language alignment, action feasibility, and temporal transition consistency, and further updates the teacher through a Bottleneck-Projected Alignment Update to avoid noisy feedback contamination. With OpenVLA as the backbone, SemiVLA consistently improves multiple PEFT strategies across LIBERO and CALVIN. Under 10% labeled trajectories, SemiVLA with Selective LoRA achieves 89.0% average success on LIBERO, outperforming supervised LoRA by 8.0 points without extra inference cost.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 21 of its 25 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
21 of 25 references.
Closest ancestors · 6
Same direction, newest first
- 2025Mechanistic Finetuning of Vision-Language-Action Models via Few-Shot Demonstrations27 Nov
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model11 Sep
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 15
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,060
- 2016Deep Variational Information Bottleneckcited by 930
- 2024Latent Action Pretraining from Videoscited by 321
- 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
- 2021Vision Transformers are Robust Learnerscited by 207
3 more
- 2021Are Transformers More Robust Than CNNs?cited by 187
- 2022Understanding The Robustness in Vision Transformerscited by 144
- 2024Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videoscited by 69
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Triple Expert Learning from Noisy Labels for Semi-Supervised Vision Foundation Model Adaptationcited by 2
- 2026Geometric Regularization for Long-Tailed Semi-Supervised Learning via Gaussian Feature Bridgescited by 1
- 2026ReCalMatch:Reliability-Calibrated Semantic Guidance for Semi-Supervised Fine-Grained Recognitioncited by 0
- 2026ReCalMatch:Reliability-Calibrated Semantic Guidance for Semi-Supervised Fine-Grained Recognition30 Aug 2026
- 2026Geometric Regularization for Long-Tailed Semi-Supervised Learning via Gaussian Feature Bridges21 Aug 2026
- 2026Triple Expert Learning from Noisy Labels for Semi-Supervised Vision Foundation Model Adaptation10 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Two Bridges, One Pathway: From VLMs to Generalizable VLAs with Embodied Trajectory-Coupled Data
- 2026LA4VLA: Learning to Act without Seeing via Language-Action Pretraining
- 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts
- 2026Mitigating State Aliasing in Vision-Language-Action Models via Inverse Dynamics Learning
- 2026FineVLA: Fine-Grained Instruction Alignment for Steerable Vision-Language-Action Policies
- 2026Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment
- 2026LoopVLA: Learning Sufficiency in Recurrent Refinement for Vision-Language-Action Models
- 2026EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training