From Points to Coalitions: Hierarchical Contrastive Shapley Values for Prioritizing Data Samples
Not on the map. Why?
Abstract (arXiv)
How should we quantify the value of each training example when datasets are large, heterogeneous, and geometrically structured? Classical Data-Shapley answers in principle, but its O(n!) complexity and point-wise perspective are ill-suited to modern scales. We propose Hierarchical Contrastive Data Valuation (HCDV), a three-stage framework that (i) learns a contrastive, geometry-preserving representation, (ii) organizes the data into a balanced coarse-to-fine hierarchy of clusters, and (iii) assigns Shapley-style payoffs to coalitions via local Monte-Carlo games whose budgets are propagated downward. HCDV collapses the factorial burden to O(T sum_{l} K_{l}) = O(T K_max log n), rewards examples that sharpen decision boundaries, and regularizes outliers through curvature-based smoothness. We prove that HCDV approximately satisfies the four Shapley axioms with surplus loss O(eta log n), enjoys sub-Gaussian coalition deviation tilde O(1/sqrt{T}), and incurs at most k epsilon_infty regret for top-k selection. Experiments on four benchmarks--tabular, vision, streaming, and a 45M-sample CTR task--plus the OpenDataVal suite show that HCDV lifts accuracy by up to +5 pp, slashes valuation time by up to 100x, and directly supports tasks such as augmentation filtering, low-latency streaming updates, and fair marketplace payouts.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 21 of its 45 references that are in the map. First posted on arXiv 22 Dec 2025.
Builds on
21 of 45 references.
References · 21
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
- 2019Towards Efficient Data Valuation Based on the Shapley Valuecited by 281
- 2021Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learningcited by 165
- 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 148
- 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 132
- 2020A Principled Approach to Data Valuation for Federated Learningcited by 127
- 2021Data Collection and Quality Challenges in Deep Learning: A Data-Centric AI Perspectivecited by 116
- 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 90
- 2019Active Federated Learningcited by 63
- 2020A Survey on Data Pricing: from Economics to Data Sciencecited by 39
9 more
- 2019Less Is Better: Unweighted Data Subsampling via Influence Functioncited by 30
- 2024Swift Sampler: Efficient Learning of Sampler by 10 Parameterscited by 25
- 2021Improving Fairness for Data Valuation in Horizontal Federated Learningcited by 22
- 2024Machine Learning Data Practices through a Data Curation Lens: An Evaluation Frameworkcited by 18
- 2023Data Valuation and Detections in Federated Learningcited by 17
- 2022Variance reduced Shapley value estimation for trustworthy data valuationcited by 16
- 2023DU-Shapley: A Shapley Value Proxy for Efficient Dataset Valuationcited by 12
- 2025MemeBLIP2: A novel lightweight multimodal system to detect harmful memescited by 8
- 2023A Survey of Data Pricing for Data Marketplacescited by 6
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026EEO-TFV: Escape-Explore Optimizer for Web-Scale Time-Series Forecasting and Vision Analysiscited by 9
- 2026TimeSAF: Towards LLM-Guided Semantic Asynchronous Fusion for Time Series Forecastingcited by 5
- 2026Curvature-Adaptive Consistency Flow Matching: Autonomous Trajectory Optimization via Reinforcement Learningcited by 4
- 2026Time-TK: A Multi-Offset Temporal Interaction Framework Combining Transformer and Kolmogorov-Arnold Networks for Time Series Forecastingcited by 2
- 2026MedTri: A Platform for Structured Medical Report Normalization to Enhance Vision-Language Pretrainingcited by 2
- 2026Sharpness-Aware Minimization for Generalized Embedding Learning in Federated Recommendationcited by 0
- 2026Taming the Long Tail: Efficient Item-wise Sharpness-Aware Minimization for LLM-based Recommender Systemscited by 0
- 2026MHMamba: Multi-Head Mamba for 3D Brain Tumor Segmentationcited by 0
- 2026Foundation-Assisted Active Learning for Object Detection Annotationcited by 0
- 2026Scope3Trace: Evidence-Based Identification and Extraction of Scope 3 GHG Emissions from Sustainability Reportscited by 0
- 2026AsyncCouple-Flow: Asynchronous Cross-Modal Coupling and Flow Matching for Spatio-Temporal Forecastingcited by 0
- 2026CoRe: Coherence and Relational Alignment for Multivariate Time Series Forecastingcited by 0
- 2026CoRe: Coherence and Relational Alignment for Multivariate Time Series Forecasting17 Sep 2026
- 2026AsyncCouple-Flow: Asynchronous Cross-Modal Coupling and Flow Matching for Spatio-Temporal Forecasting15 Sep 2026
- 2026Scope3Trace: Evidence-Based Identification and Extraction of Scope 3 GHG Emissions from Sustainability Reports19 Jul 2026
- 2026Foundation-Assisted Active Learning for Object Detection Annotation18 Jul 2026
- 2026Curvature-Adaptive Consistency Flow Matching: Autonomous Trajectory Optimization via Reinforcement Learning21 Jun 2026
- 2026MHMamba: Multi-Head Mamba for 3D Brain Tumor Segmentation15 May 2026
- 2026TimeSAF: Towards LLM-Guided Semantic Asynchronous Fusion for Time Series Forecasting14 Apr 2026
- 2026Taming the Long Tail: Efficient Item-wise Sharpness-Aware Minimization for LLM-based Recommender Systems13 Mar 2026
- 2026Sharpness-Aware Minimization for Generalized Embedding Learning in Federated Recommendation12 Mar 2026
- 2026MedTri: A Platform for Structured Medical Report Normalization to Enhance Vision-Language Pretraining25 Feb 2026
- 2026Time-TK: A Multi-Offset Temporal Interaction Framework Combining Transformer and Kolmogorov-Arnold Networks for Time Series Forecasting30 Jan 2026
- 2026EEO-TFV: Escape-Explore Optimizer for Web-Scale Time-Series Forecasting and Vision Analysis30 Jan 2026