mlsanityData to 14 Oct 2026

DAVED: Data Acquisition via Experimental Design for Data Markets

arXiv 2403.13893 ↗First posted 20 Mar 2024cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

The acquisition of training data is crucial for machine learning applications. Data markets can increase the supply of data, particularly in data-scarce domains such as healthcare, by incentivizing potential data providers to join the market. A major challenge for a data buyer in such a market is choosing the most valuable data points from a data seller. Unlike prior work in data valuation, which assumes centralized data access, we propose a federated approach to the data acquisition problem that is inspired by linear experimental design. Our proposed data acquisition method achieves lower prediction error without requiring labeled validation data and can be optimized in a fast and federated procedure. The key insight of our work is that a method that directly estimates the benefit of acquiring data for test set prediction is particularly compatible with a decentralized market setting.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 34 of its 68 references that are in the map. First posted on arXiv 20 Mar 2024.

Builds on

34 of 68 references.

References · 34

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  4. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  5. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,621
  6. 2021Convex optimizationcited by 2,515
  7. 2018A Convergence Theory for Deep Learning via Over-Parameterizationcited by 787
  8. 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 641
  9. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
  10. 2020What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimationcited by 497
  11. 2023TRAK: Attributing Model Behavior at Scalecited by 283
  12. 2020Influence Functions in Deep Learning Are Fragilecited by 252
22 more
  1. 2020Feature Learning in Infinite-Width Neural Networkscited by 190
  2. 2020Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernelcited by 187
  3. 2021Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Datasetcited by 185
  4. 2021Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learningcited by 165
  5. 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 148
  6. 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 132
  7. 2022A Kernel-Based View of Language Model Fine-Tuningcited by 121
  8. 2019Data Valuation using Reinforcement Learningcited by 116
  9. 2018A Marketplace for Data: An Algorithmic Solutioncited by 76
  10. 2023LAVA: Data Valuation without Pre-Specified Learning Algorithmscited by 69
  11. 2023OpenDataVal: a Unified Benchmark for Data Valuationcited by 55
  12. 2023Data-OOB: Out-of-bag Estimate as a Simple and Efficient Data Valuecited by 38
  13. 2021Properties of the After Kernelcited by 27
  14. 2022TCT: Convexifying Federated Learning using Bootstrapped Neural Tangent Kernelscited by 26
  15. 2017Near-Optimal Discrete Optimization for Experimental Design: A Regret Minimization Approachcited by 19
  16. 2022Fundamentals of Task-Agnostic Data Valuationcited by 19
  17. 2020Analysis of the Frank-Wolfe Method for Convex Composite Optimization involving a Logarithmically-Homogeneous Barriercited by 11
  18. 2023Data Acquisition: A New Frontier in Data-centric AIcited by 9
  19. 2023Evaluating and Incentivizing Diverse Data Contributions in Collaborative Learningcited by 8
  20. 2024Between Copyright and Computer Science: The Law and Ethics of Generative AIcited by 6
  21. 2023Addressing Budget Allocation and Revenue Allocation in Data Market Environments Using an Adaptive Sampling Algorithmcited by 5
  22. 2021Optimal Probing with Statistical Guarantees for Network Monitoring at Scalecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 2.

6 papers.