mlsanityData to 14 Oct 2026

Primitive Subspaces Mediate Few-Shot Transfer in VLAs

arXiv 2605.30695 ↗First posted 29 May 2026cs.ROcited by 0

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Deploying vision-language-action (VLA) policies in industrial environments requires the ability to teach new tasks at low cost, a property current VLAs lack, since each new task requires fine-tuning. We investigate whether primitive-aware training produces a transferable artifact: a learned library of sub-skills that can be composed at inference time, conditioned on a small number of demonstrations, to perform tasks the policy was never trained on. We train two VLA architectures with different inductive biases, OpenVLA and π0.5, on the REASSEMBLE contact-rich assembly dataset under matched LoRA fine-tuning recipes and locked hyperparameters, varying training between flat trajectories and primitive-segmented episodes with primitive-specific language prompts. We hold out 6 object-task combinations from training and evaluate few-shot transfer: models receive m ∈ 0, 1, 3, 5, 10 demonstrations of a held-out task and attempt execution without weight updates. We replicate across three training seeds and validate on a second dataset (LIBERO-Long). Primitive-trained models reach 78% of fine-tuned upper-bound performance with only m=3 demonstrations, while flat-trained models require m=10 demonstrations to reach the same level -- a 3× sample efficiency gap that replicates across seeds, architectures, and datasets. To establish causation, we ablate the primitive-decodable subspace of hidden states and show few-shot transfer degrades by 32 percentage points while ablating a random subspace of equal dimensionality has no effect, indicating primitive representations are causally necessary rather than incidentally correlated with transfer. We identify and correct a methodological pitfall in evaluating chunked policies: family-wise inflation of single-step action-range gates produces order-of-magnitude higher false-failure rates against ground-truth human demonstrations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 15 of its 19 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

15 of 19 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 13

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  4. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  6. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  7. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  8. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  9. 2024PaliGemma: A versatile 3B VLM for transfercited by 696
  10. 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 455
  11. 2023LEACE: Perfect linear concept erasure in closed formcited by 267
  12. 2024RT-H: Action Hierarchies Using Languagecited by 210
1 more
  1. 2023HYDRA: Hybrid Robot Actions for Imitation Learningcited by 55

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025VLAs are Confined yet Capable of Generalizing to Novel Instructions
  2. 2026InSight: Self-Guided Skill Acquisition via Steerable VLAs
  3. 2026DREAMSTEER: Latent World Models Can Steer VLA Policies During Deployment Without Any Finetuning
  4. 2026PrimitiveVLA: Learning Reusable Motion Primitives for Efficient and Generalizable Robotic Manipulation
  5. 2026When Listening Becomes Easier: Scrubbing Visual Cues for Shortcut-Free VLAs
  6. 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models
  7. 2025Actions as Language: Fine-Tuning VLMs into VLAs Without Catastrophic Forgetting
  8. 2026Observing and Controlling Features in Vision-Language-Action Models