Primitive Subspaces Mediate Few-Shot Transfer in VLAs
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
Deploying vision-language-action (VLA) policies in industrial environments requires the ability to teach new tasks at low cost, a property current VLAs lack, since each new task requires fine-tuning. We investigate whether primitive-aware training produces a transferable artifact: a learned library of sub-skills that can be composed at inference time, conditioned on a small number of demonstrations, to perform tasks the policy was never trained on. We train two VLA architectures with different inductive biases, OpenVLA and π0.5, on the REASSEMBLE contact-rich assembly dataset under matched LoRA fine-tuning recipes and locked hyperparameters, varying training between flat trajectories and primitive-segmented episodes with primitive-specific language prompts. We hold out 6 object-task combinations from training and evaluate few-shot transfer: models receive m ∈ 0, 1, 3, 5, 10 demonstrations of a held-out task and attempt execution without weight updates. We replicate across three training seeds and validate on a second dataset (LIBERO-Long). Primitive-trained models reach 78% of fine-tuned upper-bound performance with only m=3 demonstrations, while flat-trained models require m=10 demonstrations to reach the same level -- a 3× sample efficiency gap that replicates across seeds, architectures, and datasets. To establish causation, we ablate the primitive-decodable subspace of hidden states and show few-shot transfer degrades by 32 percentage points while ablating a random subspace of equal dimensionality has no effect, indicating primitive representations are causally necessary rather than incidentally correlated with transfer. We identify and correct a methodological pitfall in evaluating chunked policies: family-wise inflation of single-step action-range gates produces order-of-magnitude higher false-failure rates against ground-truth human demonstrations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 15 of its 19 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
15 of 19 references.
Closest ancestors · 2
Same direction, newest first
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 13
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 455
- 2023LEACE: Perfect linear concept erasure in closed formcited by 267
- 2024RT-H: Action Hierarchies Using Languagecited by 210
1 more
- 2023HYDRA: Hybrid Robot Actions for Imitation Learningcited by 55
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025VLAs are Confined yet Capable of Generalizing to Novel Instructions
- 2026InSight: Self-Guided Skill Acquisition via Steerable VLAs
- 2026DREAMSTEER: Latent World Models Can Steer VLA Policies During Deployment Without Any Finetuning
- 2026PrimitiveVLA: Learning Reusable Motion Primitives for Efficient and Generalizable Robotic Manipulation
- 2026When Listening Becomes Easier: Scrubbing Visual Cues for Shortcut-Free VLAs
- 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models
- 2025Actions as Language: Fine-Tuning VLMs into VLAs Without Catastrophic Forgetting
- 2026Observing and Controlling Features in Vision-Language-Action Models