Quality over Quantity: Demonstration Curation via Influence Functions for Data-Centric Robot Learning
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
Abstract (arXiv)
Learning from demonstrations has emerged as a promising paradigm for end-to-end robot control, particularly when scaled to diverse and large datasets. However, the quality of demonstration data, often collected through human teleoperation, remains a critical bottleneck for effective data-driven robot learning. Human errors, operational constraints, and teleoperator variability introduce noise and suboptimal behaviors, making data curation essential yet largely manual and heuristic-driven. In this work, we propose Quality over Quantity (QoQ), a grounded and systematic approach to identifying high-quality data by defining data quality as the contribution of each training sample to reducing loss on validation demonstrations. To efficiently estimate this contribution, we leverage influence functions, which quantify the impact of individual training samples on model performance. We further introduce two key techniques to adapt influence functions for robot demonstrations: (i) using maximum influence across validation samples to capture the most relevant state-action pairs, and (ii) aggregating influence scores of state-action pairs within the same trajectory to reduce noise and improve data coverage. Experiments in both simulated and real-world settings show that QoQ consistently improves policy performances over prior data selection methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 31 of its 35 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
31 of 35 references.
Closest ancestors · 8
Same direction, newest first
- 2025CUPID: Curating Data your Robot Loves with Influence Functions23 Jun
- 2025DataMIL: Selecting Data for Robot Imitation Learning with Datamodels14 May
- 2025Robot Data Curation with Mutual Information Estimators12 Feb
- 2024FlowRetrieval: Flow-Guided Data Retrieval for Few-Shot Imitation Learning29 Aug
- 2023BridgeData V2: A Dataset for Robot Learning at Scale24 Aug
- 2023Data Quality in Imitation Learning4 Jun
- 2023Behavior Retrieval: Few-Shot Imitation Learning by Querying Unlabeled Datasets18 Apr
- 2022Learning and Retrieval from Prior Data for Skill-based Imitation Learning20 Oct
Other references · 23
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
11 more
- 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 565
- 2017DART: Noise Injection for Robust Imitation Learningcited by 187
- 2021Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learningcited by 162
- 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 147
- 2023DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Modelscited by 121
- 2025Flow Matching Policy Gradientscited by 86
- 2023The Journey, Not the Destination: How Data Guides Diffusion Modelscited by 42
- 2024STRAP: Robot Sub-Trajectory Retrieval for Augmented Policy Learningcited by 42
- 2025Curating Demonstrations using Online Experiencecited by 16
- 2023OPORP: One Permutation + One Random Projectioncited by 11
- 2025Understanding Impact of Human Feedback via Influence Functionscited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Consistency Matters: Defining Demonstration Data Quality Metrics in Robot Learning from Demonstration
- 2022Quantifying Demonstration Quality for Robot Learning and Generalization
- 2026AXIS: A Growable Community-Driven Data Engine for Scalable Robot Manipulation
- 2026An Efficient Metric for Data Quality Measurement in Imitation Learning
- 2026Learning from the Best: Smoothness-Driven Metrics for Data Quality in Imitation Learning
- 2024Learning from Imperfect Demonstrations with Self-Supervision for Robotic Manipulation
- 2023Learning to Discern: Imitating Heterogeneous Human Demonstrations with Preference and Representation Learning
- 2025Action Chunking and Exploratory Data Collection Yield Exponential Improvements in Behavior Cloning for Continuous Control