CUPID: Curating Data your Robot Loves with Influence Functions
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
Abstract (arXiv)
In robot imitation learning, policy performance is tightly coupled with the quality and composition of the demonstration data. Yet, developing a precise understanding of how individual demonstrations contribute to downstream outcomes - such as closed-loop task success or failure - remains a persistent challenge. We propose CUPID, a robot data curation method based on a novel influence function-theoretic formulation for imitation learning policies. Given a set of evaluation rollouts, CUPID estimates the influence of each training demonstration on the policy's expected return. This enables ranking and selection of demonstrations according to their impact on the policy's closed-loop performance. We use CUPID to curate data by 1) filtering out training demonstrations that harm policy performance and 2) subselecting newly collected trajectories that will most improve the policy. Extensive simulated and hardware experiments show that our approach consistently identifies which data drives test-time performance. For example, training with less than 33% of curated data can yield state-of-the-art diffusion policies on the simulated RoboMimic benchmark, with similar gains observed in hardware. Furthermore, hardware experiments show that our method can identify robust strategies under distribution shift, isolate spurious correlations, and even enhance the post-training of generalist robot policies. Videos and code are made available at: https://cupid-curation.github.io.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 55 of its 63 references that are in the map. First posted on arXiv 23 Jun 2025.
Builds on
55 of 63 references.
Closest ancestors · 9
Same direction, newest first
- 2025DataMIL: Selecting Data for Robot Imitation Learning with Datamodels14 May
- 2025Robot Data Curation with Mutual Information Estimators12 Feb
- 2024Re-Mix: Optimizing Data Mixtures for Large Scale Imitation Learning26 Aug
- 2024How Generalizable Is My Behavior Cloning Policy? A Statistical Approach to Trustworthy Performance Evaluation8 May
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations26 Oct
- 2023Learning to Discern: Imitating Heterogeneous Human Demonstrations with Preference and Representation Learning22 Oct
- 2023Data Quality in Imitation Learning4 Jun
- 2022CACTI: A Framework for Scalable Multi-Task Multi-Scene Visual Imitation Learning12 Dec
- 2022Eliciting Compatible Demonstrations for Multi-Human Imitation Learning14 Oct
Other references · 46
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
34 more
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
- 2021Deduplicating Training Data Makes Language Models Bettercited by 714
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
- 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
- 2014New insights and perspectives on the natural gradient methodcited by 443
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
- 2023Studying Large Language Model Generalization with Influence Functionscited by 326
- 2019Causal Confusion in Imitation Learningcited by 288
- 2023TRAK: Attributing Model Behavior at Scalecited by 283
- 2020Influence Functions in Deep Learning Are Fragilecited by 252
- 2024A Survey on Data Selection for Language Modelscited by 236
- 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 177
- 2023D4: Improving LLM Pretraining via Document De-Duplication and Diversificationcited by 150
- 2019On the Accuracy of Influence Functions for Measuring Group Effectscited by 147
- 2022If Influence Functions are the Answer, Then What is the Question?cited by 144
- 2022Training Data Influence Analysis and Estimation: A Surveycited by 135
- 2024DsDm: Model-Aware Dataset Selection with Datamodelscited by 105
- 2024What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functionscited by 94
- 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progresscited by 69
- 2024Real-Time Anomaly Detection and Reactive Planning with Large Language Modelscited by 68
- 2024RACER: Rich Language-Guided Failure Recovery Policies for Imitation Learningcited by 49
- 2023Intriguing Properties of Data Attribution on Diffusion Modelscited by 47
- 2023The Journey, Not the Destination: How Data Guides Diffusion Modelscited by 43
- 2024Influence Functions for Scalable Data Attribution in Diffusion Modelscited by 33
- 2022ModelDiff: A Framework for Comparing Learning Algorithmscited by 30
- 2024TSDS: Data Selection for Task-Specific Model Finetuningcited by 28
- 2025Optimizing ML Training with Metagradient Descentcited by 23
- 2024Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Modelscited by 22
- 2025MAGIC: Near-Optimal Data Attribution for Deep Learningcited by 22
- 2019Uncertainty-Aware Data Aggregation for Deep Imitation Learningcited by 20
- 2024Attribute-to-Delete: Machine Unlearning via Datamodel Matchingcited by 18
- 2025Curating Demonstrations using Online Experiencecited by 18
- 2024Data Attribution for Diffusion Models: Timestep-induced Bias in Influence Estimationcited by 14
- 2024STEER: Flexible Robotic Manipulation via Dense Language Groundingcited by 14
Built on by
Citing papers per year: 2025: 4; 2026: 19.
23 papers.
Sort:
By area:
- 2026Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisonscited by 60
- 2026World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetrycited by 18
- 2026Interpretability Can Be Actionablecited by 7
- 2025X-Diffusion: Training Diffusion Policies on Cross-Embodiment Human Demonstrationscited by 6
- 2025Using Non-Expert Data to Robustify Imitation Learning via Offline Reinforcement Learningcited by 5
- 2026Ambient Diffusion Policy: Imitation Learning from Suboptimal Data in Roboticscited by 4
- 2026Uncertainty Quantification for Flow-Based Vision-Language-Action Modelscited by 4
- 2025RDD: Retrieval-Based Demonstration Decomposer for Planner Alignment in Long-Horizon Taskscited by 3
- 2026Learning from the Best: Smoothness-Driven Metrics for Data Quality in Imitation Learningcited by 3
- 2026SiMDex: Mining Similar Egocentric Videos for Cross-Embodiment Dexterous Manipulationcited by 3
- 2026An Efficient Metric for Data Quality Measurement in Imitation Learningcited by 2
- 2026FACTR 2: Learning External Force Sensing for Commodity Robot Arms Improves Policy Learningcited by 2
11 more
- 2025Revisiting Data Attribution for Influence Functionscited by 1
- 2026Quality over Quantity: Demonstration Curation via Influence Functions for Data-Centric Robot Learningcited by 1
- 2026ATHENA: Accelerated Multi-Task Heterogeneous Influence Functions for Robot Data Curationcited by 1
- 2026Active Real-World Factor-Based Evaluation for Generalist Robot Policiescited by 1
- 2026Rethinking Demonstration Unlearning in Imitation Learning for Roboticscited by 1
- 2026Geometric Entropy: When Trajectory Diversity Helps and Hurts in Imitation Learningcited by 0
- 2026Auditing Instruction-Trajectory Mismatches in Multimodal Robot Demonstrationscited by 0
- 2026Imperfection for Precision: Upcycling Imperfect Data for High-Precision Robotic Manipulationcited by 0
- 2026Beyond State-as-Action: Exploiting Command-State Discrepancy for Robot Imitation Learningcited by 0
- 2026NEEDLEWORK: Offline Rewriting of Robot Data with Verified Local Stitchescited by 0
- 2026Where Small Mistakes Matter: Quantifying State Criticality for Imitation Learningcited by 0
- 2026Where Small Mistakes Matter: Quantifying State Criticality for Imitation Learning13 Oct 2026
- 2026NEEDLEWORK: Offline Rewriting of Robot Data with Verified Local Stitches1 Oct 2026
- 2026Beyond State-as-Action: Exploiting Command-State Discrepancy for Robot Imitation Learning27 Sep 2026
- 2026Imperfection for Precision: Upcycling Imperfect Data for High-Precision Robotic Manipulation22 Sep 2026
- 2026Rethinking Demonstration Unlearning in Imitation Learning for Robotics21 Aug 2026
- 2026Auditing Instruction-Trajectory Mismatches in Multimodal Robot Demonstrations8 Aug 2026
- 2026SiMDex: Mining Similar Egocentric Videos for Cross-Embodiment Dexterous Manipulation4 Aug 2026
- 2026Active Real-World Factor-Based Evaluation for Generalist Robot Policies16 Jul 2026
- 2026Geometric Entropy: When Trajectory Diversity Helps and Hurts in Imitation Learning18 Jun 2026
- 2026Uncertainty Quantification for Flow-Based Vision-Language-Action Models16 Jun 2026
- 2026ATHENA: Accelerated Multi-Task Heterogeneous Influence Functions for Robot Data Curation15 Jun 2026
- 2026FACTR 2: Learning External Force Sensing for Commodity Robot Arms Improves Policy Learning10 Jun 2026
11 more
- 2026Ambient Diffusion Policy: Imitation Learning from Suboptimal Data in Robotics10 Jun 2026
- 2026Interpretability Can Be Actionable11 May 2026
- 2026An Efficient Metric for Data Quality Measurement in Imitation Learning2 May 2026
- 2026Learning from the Best: Smoothness-Driven Metrics for Data Quality in Imitation Learning24 Apr 2026
- 2026World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetry2 Apr 2026
- 2026Quality over Quantity: Demonstration Curation via Influence Functions for Data-Centric Robot Learning10 Mar 2026
- 2026Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisons2 Mar 2026
- 2025X-Diffusion: Training Diffusion Policies on Cross-Embodiment Human Demonstrations6 Nov 2025
- 2025Using Non-Expert Data to Robustify Imitation Learning via Offline Reinforcement Learning22 Oct 2025
- 2025RDD: Retrieval-Based Demonstration Decomposer for Planner Alignment in Long-Horizon Tasks16 Oct 2025
- 2025Revisiting Data Attribution for Influence Functions10 Aug 2025
- 2025Using Non-Expert Data to Robustify Imitation Learning via Offline Reinforcement Learningcited by 5
- 2026Learning from the Best: Smoothness-Driven Metrics for Data Quality in Imitation Learningcited by 3
- 2026An Efficient Metric for Data Quality Measurement in Imitation Learningcited by 2
- 2026Quality over Quantity: Demonstration Curation via Influence Functions for Data-Centric Robot Learningcited by 1
- 2026Rethinking Demonstration Unlearning in Imitation Learning for Roboticscited by 1
- 2026Geometric Entropy: When Trajectory Diversity Helps and Hurts in Imitation Learningcited by 0
- 2026Beyond State-as-Action: Exploiting Command-State Discrepancy for Robot Imitation Learningcited by 0
- 2026Where Small Mistakes Matter: Quantifying State Criticality for Imitation Learningcited by 0
- 2026Where Small Mistakes Matter: Quantifying State Criticality for Imitation Learning13 Oct 2026
- 2026Beyond State-as-Action: Exploiting Command-State Discrepancy for Robot Imitation Learning27 Sep 2026
- 2026Rethinking Demonstration Unlearning in Imitation Learning for Robotics21 Aug 2026
- 2026Geometric Entropy: When Trajectory Diversity Helps and Hurts in Imitation Learning18 Jun 2026
- 2026An Efficient Metric for Data Quality Measurement in Imitation Learning2 May 2026
- 2026Learning from the Best: Smoothness-Driven Metrics for Data Quality in Imitation Learning24 Apr 2026
- 2026Quality over Quantity: Demonstration Curation via Influence Functions for Data-Centric Robot Learning10 Mar 2026
- 2025Using Non-Expert Data to Robustify Imitation Learning via Offline Reinforcement Learning22 Oct 2025
- 2026Uncertainty Quantification for Flow-Based Vision-Language-Action Modelscited by 4
- 2026ATHENA: Accelerated Multi-Task Heterogeneous Influence Functions for Robot Data Curationcited by 1
- 2026Auditing Instruction-Trajectory Mismatches in Multimodal Robot Demonstrationscited by 0
- 2026Imperfection for Precision: Upcycling Imperfect Data for High-Precision Robotic Manipulationcited by 0
- 2026Imperfection for Precision: Upcycling Imperfect Data for High-Precision Robotic Manipulation22 Sep 2026
- 2026Auditing Instruction-Trajectory Mismatches in Multimodal Robot Demonstrations8 Aug 2026
- 2026Uncertainty Quantification for Flow-Based Vision-Language-Action Models16 Jun 2026
- 2026ATHENA: Accelerated Multi-Task Heterogeneous Influence Functions for Robot Data Curation15 Jun 2026
- 2026Interpretability Can Be Actionablecited by 7
- 2026SiMDex: Mining Similar Egocentric Videos for Cross-Embodiment Dexterous Manipulationcited by 3
- 2026FACTR 2: Learning External Force Sensing for Commodity Robot Arms Improves Policy Learningcited by 2
- 2025Revisiting Data Attribution for Influence Functionscited by 1
- 2026Active Real-World Factor-Based Evaluation for Generalist Robot Policiescited by 1
- 2026NEEDLEWORK: Offline Rewriting of Robot Data with Verified Local Stitchescited by 0
- 2026NEEDLEWORK: Offline Rewriting of Robot Data with Verified Local Stitches1 Oct 2026
- 2026SiMDex: Mining Similar Egocentric Videos for Cross-Embodiment Dexterous Manipulation4 Aug 2026
- 2026Active Real-World Factor-Based Evaluation for Generalist Robot Policies16 Jul 2026
- 2026FACTR 2: Learning External Force Sensing for Commodity Robot Arms Improves Policy Learning10 Jun 2026
- 2026Interpretability Can Be Actionable11 May 2026
- 2025Revisiting Data Attribution for Influence Functions10 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning
- 2024Efficient Data Collection for Robotic Manipulation via Compositional Generalization
- 2025What Matters in Learning from Large-Scale Datasets for Robot Manipulation
- 2023BridgeData V2: A Dataset for Robot Learning at Scale
- 2024Data Scaling Laws in Imitation Learning for Robotic Manipulation
- 2024VITAL: Interactive Few-Shot Imitation Learning via Visual Human-in-the-Loop Corrections
- 2026SIEVE: Structure-Aware Data Selection for Imitation Learning with VLA Models
- 2020Scalable Multi-Task Imitation Learning with Autonomous Improvement