mlsanityData to 7 Oct 2026

Simple-to-Complex Structured Demonstrations for Vision-Language-Action Learning

arXiv 2607.04591 ↗First posted 6 Jul 2026cs.RO cs.AIcited by 0

On the map: Vision-language-action models → Human-video and latent-action pretraining

Abstract (arXiv)

Vision-Language-Action (VLA) models have demonstrated strong capabilities in robotic manipulation by integrating visual perception, language understanding, and robot action generation. Existing research has primarily focused on improving model architectures, training strategies, and dataset scale, while little attention has been paid to how demonstrations are collected and organized. We identify demonstration organization as a fundamental yet overlooked aspect of imitation learning, as it directly affects policy learning efficiency, training stability, and policy generalization. To address this gap, we propose a simple-to-complex structured demonstration collection strategy for VLA learning using a dual-arm robotic platform. Our approach systematically organizes data through three general principles: (i) decomposing complex manipulation tasks into progressively learnable sub-skills, (ii) standardizing the interaction environment to reduce unnecessary variability, and (iii) organizing demonstrations according to progressively increasing task complexity. This structured design enables VLA models to first acquire fundamental manipulation skills before learning increasingly complex task compositions, facilitating more effective learning of long-horizon manipulation tasks. We evaluate the proposed strategy on two representative robotic manipulation tasks: block grasping and sorting, and towel folding. Experimental results show consistent improvements in task success rate and training stability compared with the baseline method of directly collecting end-to-end complete task trajectories. These findings highlight demonstration organization as a previously underexplored but important factor in VLA learning and provide practical insights into efficient skill acquisition, scalable dataset construction, and long-horizon robotic manipulation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 19 of its 22 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

19 of 22 references.

References · 19

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  3. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2020D4RL: Datasets for Deep Data-Driven Reinforcement Learningcited by 1,406
  6. 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 730
  7. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
  8. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  9. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
  10. 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
  11. 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 328
  12. 2017Overcoming Exploration in Reinforcement Learning with Demonstrationscited by 322
7 more
  1. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  2. 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
  3. 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
  4. 2017Reverse Curriculum Generation for Reinforcement Learningcited by 185
  5. 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
  6. 2026Benchmarking Vision-Language-Action Models on SO-101: Failure and Recovery Analysiscited by 3
  7. 2026Self-Evolving Cognitive Framework via Causal World Modeling for Embodied Scientific Intelligencecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025See Once, Then Act: Vision-Language-Action Model with Task Learning from One-Shot Video Demonstrations
  2. 2025Learning Compositional Behaviors from Demonstration and Language
  3. 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
  4. 2025ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Models
  5. 2026Human-to-Robot Interaction: Learning from Video Demonstration for Robot Imitation
  6. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey
  7. 2025ObjectVLA: End-to-End Open-World Object Manipulation Without Demonstration
  8. 2026Veo-Act: Enhancing VLA Policies with Frontier Video Models