Delegating Data Collection in Decentralized Machine Learning
Not on the map. Why?
Abstract (arXiv)
Motivated by the emergence of decentralized machine learning (ML) ecosystems, we study the delegation of data collection. Taking the field of contract theory as our starting point, we design optimal and near-optimal contracts that deal with two fundamental information asymmetries that arise in decentralized ML: uncertainty in the assessment of model quality and uncertainty regarding the optimal performance of any model. We show that a principal can cope with such asymmetry via simple linear contracts that achieve 1-1/e fraction of the optimal utility. To address the lack of a priori knowledge regarding the optimal performance, we give a convex program that can adaptively and efficiently compute the optimal contract. We also study linear contracts and derive the optimal utility in the more complex setting of multiple interactions.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 18 of its 44 references that are in the map. First posted on arXiv 4 Sep 2023.
Builds on
18 of 44 references.
References · 18
- 2019NAS-Bench-101: Towards Reproducible Neural Architecture Searchcited by 344
- 2021Proof-of-Learning: Definitions and Practicecited by 84
- 2018A Marketplace for Data: An Algorithmic Solutioncited by 76
- 2014Adaptive Contract Design for Crowdsourcing Markets: Bandit Algorithms for Repeated Principal-Agent Problemscited by 46
- 2018Model-based Pricing for Machine Learning in a Data Marketplacecited by 37
- 2018Simple versus Optimal Contractscited by 33
- 2021Representation Matters: Assessing the Importance of Subgroup Allocations in Training Datacited by 31
- 2014Optimum Statistical Estimation with Strategic Data Sourcescited by 28
- 2020Contracts under Moral Hazard and Adverse Selectioncited by 21
- 2020The Complexity of Contractscited by 16
- 2022Principal-Agent Hypothesis Testingcited by 14
- 2021Contracts with Private Cost per Unit-of-Effortcited by 12
6 more
- 2023Delegated Classificationcited by 10
- 2020Towards Data Auctions with Externalitiescited by 9
- 2018Delegated Search Approximates Efficient Searchcited by 7
- 2022Approximate Optimality of Linear Contracts Under Uncertaintycited by 7
- 2019Incentivized Exploration for Multi-Armed Bandits under Reward Driftcited by 6
- 2022Delegated Pandora's boxcited by 3
Built on by
Citing papers per year: 2024: 3; 2025: 4; 2026: 1.
8 papers.
- 2024Incentivizing Quality Text Generation via Statistical Contractscited by 10
- 2024Principal-Agent Reinforcement Learning: Orchestrating AI Agents with Contractscited by 9
- 2024Learning to Mitigate Externalities: the Coase Theorem with Hindsight Rationalitycited by 3
- 2025Conformal Data Contamination Tests for In-distribution Data Acquisitioncited by 1
- 2025Approaching the Harm of Gradient Attacks While Only Flipping Labelscited by 0
- 2025Incentivizing High-Quality Human Annotations with Golden Questionscited by 0
- 2025LARP: Learner-Agnostic Robust Data Prefilteringcited by 0
- 2026Microeconomic Foundations of Multi-Agent Learningcited by 0
- 2026Microeconomic Foundations of Multi-Agent Learning6 Jan 2026
- 2025Conformal Data Contamination Tests for In-distribution Data Acquisition18 Jul 2025
- 2025LARP: Learner-Agnostic Robust Data Prefiltering25 Jun 2025
- 2025Incentivizing High-Quality Human Annotations with Golden Questions25 May 2025
- 2025Approaching the Harm of Gradient Attacks While Only Flipping Labels28 Feb 2025
- 2024Principal-Agent Reinforcement Learning: Orchestrating AI Agents with Contracts25 Jul 2024
- 2024Learning to Mitigate Externalities: the Coase Theorem with Hindsight Rationality28 Jun 2024
- 2024Incentivizing Quality Text Generation via Statistical Contracts17 Jun 2024