AC-VLA: Robust Out-of-Distribution Action Execution via Compositional Learning
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action (VLA) models excel at end-to-end robotic manipulation but struggle with out-of-distribution (OOD) generalization when familiar sub-tasks are recombined in unseen configurations. We identify two mutually reinforcing failure modes: trajectory overfitting, where models overfit to holistic trajectory patterns rather than compositional sub-skill semantics; and perceptual shortcut, where action tokens over-rely on wrist-view textures at the expense of global spatial grounding. To address both, we introduce AC-VLA, a plug-and-play Action Compositional learning framework comprising two architecture-agnostic components: (i) a compositional learning module that uses an LLM-driven instruction decomposer and a proprioceptive trajectory aligner to generate dense sub-task supervision, followed by mixed training on complete demonstrations and decomposed data to endow the model with compositional generalization; and (ii) a state-conditioned asymmetric masking strategy that suppresses wrist-view inputs during closed-gripper phases, enforcing global semantic grounding. All components are architectural modification-free and directly integrable into any VLA backbone. Instantiated on π0.5 and evaluated on LIBERO and LIBERO-OOD benchmarks, AC-VLA achieves a ~28% absolute improvement on compositional OOD tasks while maintaining near-perfect in-distribution performance.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 45 of its 49 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
45 of 49 references.
Closest ancestors · 2
Same direction, newest first
- 2026Adaptive Action Chunking at Inference-time for Vision-Language-Action Models5 Apr
- 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsification28 Aug
Other references · 43
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Visual Instruction Tuningcited by 7,869
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
31 more
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 269
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Playcited by 223
- 2024Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learningcited by 189
- 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
- 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 145
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 134
- 2024Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviationcited by 114
- 2022LISA: Learning Interpretable Skill Abstractions from Languagecited by 30
- 2026When Vision Overrides Language: Evaluating and Mitigating Counterfactual Failures in VLAscited by 30
- 2024Incorporating Task Progress Knowledge for Subgoal Generation in Robotic Manipulation through Image Editscited by 15
- 2025Goal-VLA: Image-Generative VLMs as Object-Centric World Models Empowering Zero-shot Robot Manipulationcited by 15
- 2025VLAs are Confined yet Capable of Generalizing to Novel Instructionscited by 8
- 2025Learning Semantic Atomic Skills for Multi-Task Robotic Manipulationcited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026What You Can't See Is What You Learn: Slot-Selective Evidence Masking Favors Compositional Generalization in Shared-Genome Language-Model Societiescited by 1
- 2026Correcting WHERE, Preserving HOW: Compositional Generalization for Vision-Language-Action Models via Referential Guidancecited by 0
- 2026When Listening Becomes Easier: Scrubbing Visual Cues for Shortcut-Free VLAscited by 0
- 2026When Listening Becomes Easier: Scrubbing Visual Cues for Shortcut-Free VLAs7 Oct 2026
- 2026Correcting WHERE, Preserving HOW: Compositional Generalization for Vision-Language-Action Models via Referential Guidance29 Sep 2026
- 2026What You Can't See Is What You Learn: Slot-Selective Evidence Masking Favors Compositional Generalization in Shared-Genome Language-Model Societies20 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Unleashing More Actions via Action Compositional Training for VLA Models
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models
- 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models
- 2026Same Scene, Different Task: Skill Alignment for Compositional Generalization in VLAs
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2025VITA-VLA: Efficiently Teaching Vision-Language Models to Act via Action Expert Distillation
- 2026M2-VLA: Boosting Vision-Language Models for Generalizable Manipulation via Layer Mixture and Meta-Skills
- 2026Libra-VLA: Achieving Learning Equilibrium via Asynchronous Coarse-to-Fine Dual-System