mlsanityData to 14 Oct 2026

Semi-Supervised Vision-Language-Action Model

arXiv 2606.21493 ↗First posted 19 Jun 2026cs.CV cs.ETcited by 3

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Vision-Language-Action (VLA) models enable robots to predict actions directly from visual observations and language instructions, but adapting them to new environments still depends on costly action-labeled demonstrations. To reduce this dependence, we study semi-supervised VLA adaptation under limited supervision signals, where only a small portion of trajectories contain robot actions and the remaining trajectories provide action-unlabeled vision-language observations. Unlike standard semi-supervised learning, the missing supervision is an embodied action signal that must be visually grounded, language-consistent, physically feasible, and temporally stable. To address this problem, we propose SemiVLA, a self-distilled teacher-student framework that learns from reliable pseudo-actions on unlabeled trajectories. SemiVLA introduces a VLA-specific reliability controller to assess vision-language alignment, action feasibility, and temporal transition consistency, and further updates the teacher through a Bottleneck-Projected Alignment Update to avoid noisy feedback contamination. With OpenVLA as the backbone, SemiVLA consistently improves multiple PEFT strategies across LIBERO and CALVIN. Under 10% labeled trajectories, SemiVLA with Selective LoRA achieves 89.0% average success on LIBERO, outperforming supervised LoRA by 8.0 points without extra inference cost.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 21 of its 25 references that are in the map. First posted on arXiv 19 Jun 2026.

Builds on

21 of 25 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Mechanistic Finetuning of Vision-Language-Action Models via Few-Shot Demonstrations27 Nov
  2. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model11 Sep
  3. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 15

  1. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
  2. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
  3. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  4. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
  5. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  6. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  7. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  8. 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,060
  9. 2016Deep Variational Information Bottleneckcited by 930
  10. 2024Latent Action Pretraining from Videoscited by 321
  11. 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
  12. 2021Vision Transformers are Robust Learnerscited by 207
3 more
  1. 2021Are Transformers More Robust Than CNNs?cited by 187
  2. 2022Understanding The Robustness in Vision Transformerscited by 144
  3. 2024Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videoscited by 69

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Two Bridges, One Pathway: From VLMs to Generalizable VLAs with Embodied Trajectory-Coupled Data
  2. 2026LA4VLA: Learning to Act without Seeing via Language-Action Pretraining
  3. 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts
  4. 2026Mitigating State Aliasing in Vision-Language-Action Models via Inverse Dynamics Learning
  5. 2026FineVLA: Fine-Grained Instruction Alignment for Steerable Vision-Language-Action Policies
  6. 2026Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment
  7. 2026LoopVLA: Learning Sufficiency in Recurrent Refinement for Vision-Language-Action Models
  8. 2026EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training