mlsanityData to 7 Oct 2026

SIEVE: Structure-Aware Data Selection for Imitation Learning with VLA Models

arXiv 2607.06442 ↗First posted 7 Jul 2026cs.ROcited by 0

On the map: Vision-language-action models → Human-video and latent-action pretraining

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models are typically trained by imitation learning on large-scale robot demonstration datasets, but more data does not necessarily yield better policies due to redundancy, noise, and uneven coverage. Existing data selection methods often assess demonstrations at either the trajectory or state-action level, missing the reusable structures that compose long-horizon behaviors. In this paper, we propose SIEVE, a structure-aware data selection method for VLA imitation learning. SIEVE views demonstrations as compositions of reusable primitives and transition interfaces. It first discovers visuo-motor primitives from segmented trajectories, then allocates selection budgets to composition patterns by maximizing reuse-aware structural exposure under diminishing returns. Finally, it selects medoid trajectories within each composition-pattern bucket to retain central, stable, and imitation-friendly demonstrations. Experiments across multiple datasets, benchmarks, and VLA models show that SIEVE consistently outperforms competitive data selection baselines. Notably, SIEVE can surpass full-data training while using only 50% of demonstrations and 50% of training steps, suggesting that reusable structure, captured through primitives and transitions, is an important signal for efficient VLA imitation learning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 24 of its 33 references that are in the map. First posted on arXiv 7 Jul 2026.

Builds on

24 of 33 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026FrameSkip: Learning from Fewer but More Informative Frames in VLA Training13 May

Other references · 23

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  6. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  7. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  8. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  9. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  10. 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 144
  11. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
  12. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 66
11 more
  1. 2024Re-Mix: Optimizing Data Mixtures for Large Scale Imitation Learningcited by 44
  2. 2026From Entropy to Epiplexity: Rethinking Information for Computationally Bounded Intelligencecited by 39
  3. 2025Robot Data Curation with Mutual Information Estimatorscited by 34
  4. 2025Shortcut Learning in Generalist Robot Policies: The Role of Dataset Diversity and Fragmentationcited by 31
  5. 2025DataMIL: Selecting Data for Robot Imitation Learning with Datamodelscited by 25
  6. 2025PhysBrain: Human Egocentric Data as a Bridge from Vision Language Models to Physical Intelligencecited by 10
  7. 2025SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learningcited by 9
  8. 2026IntentVLA: Short-Horizon Intent Modeling for Aliased Robot Manipulationcited by 7
  9. 2026ScalSelect: Scalable Training-Free Multimodal Data Selection for Efficient Visual Instruction Tuningcited by 5
  10. 2025Quality Over Quantity: Curating Contact-Based Robot Datasets Improves Learningcited by 1
  11. 2026ATHENA: Accelerated Multi-Task Heterogeneous Influence Functions for Robot Data Curationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Simple-to-Complex Structured Demonstrations for Vision-Language-Action Learning
  2. 2026Unleashing More Actions via Action Compositional Training for VLA Models
  3. 2025LLM Trainer: Automated Robotic Data Generation via Demonstration Augmentation using LLMs
  4. 2026CLASP: Language-Driven Robot Skill Selection and Composition using Task-Parameterized Learning
  5. 2026VLA-REPLICA: A Low-Cost, Reproducible Benchmark for Real-World Evaluation of Vision-Language-Action Models
  6. 2022Learning and Retrieval from Prior Data for Skill-based Imitation Learning
  7. 2025HybridGen: VLM-Guided Hybrid Planning for Scalable Data Generation of Imitation Learning
  8. 2024Towards Diverse Behaviors: A Benchmark for Imitation Learning with Human Demonstrations