mlsanityData to 7 Oct 2026

Model-Based Data-Centric AI: Bridging the Divide Between Academic Ideals and Industrial Pragmatism

arXiv 2403.01832 ↗First posted 4 Mar 2024cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper delves into the contrasting roles of data within academic and industrial spheres, highlighting the divergence between Data-Centric AI and Model-Agnostic AI approaches. We argue that while Data-Centric AI focuses on the primacy of high-quality data for model performance, Model-Agnostic AI prioritizes algorithmic flexibility, often at the expense of data quality considerations. This distinction reveals that academic standards for data quality frequently do not meet the rigorous demands of industrial applications, leading to potential pitfalls in deploying academic models in real-world settings. Through a comprehensive analysis, we address these disparities, presenting both the challenges they pose and strategies for bridging the gap. Furthermore, we propose a novel paradigm: Model-Based Data-Centric AI, which aims to reconcile these differences by integrating model considerations into data optimization processes. This approach underscores the necessity for evolving data requirements that are sensitive to the nuances of both academic research and industrial deployment. By exploring these discrepancies, we aim to foster a more nuanced understanding of data's role in AI development and encourage a convergence of academic and industrial standards to enhance AI's real-world applicability.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 18 references that are in the map. First posted on arXiv 4 Mar 2024.

Builds on

11 of 18 references.

References · 11

  1. 2023A Survey of Large Language Modelscited by 2,537
  2. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  3. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  4. 2024Self-Rewarding Language Modelscited by 654
  5. 2021Curriculum Learning: A Surveycited by 257
  6. 2021Data Quality Toolkit: Automatic assessment of data quality and remediation for machine learning datasetscited by 18
  7. 2023DMOps: Data Management Operation and Recipescited by 7
  8. 2023Inter-Annotator Agreement in the Wild: Uncovering Its Emerging Roles and Considerations in Real-World Scenarioscited by 4
  9. 2023Improving Scene Text Recognition for Character-Level Long-Tailed Distributioncited by 3
  10. 2022Curator: Creating Large-Scale Curated Labelled Datasets using Self-Supervised Learningcited by 1
  11. 2023Transcending Traditional Boundaries: Leveraging Inter-Annotator Agreement (IAA) for Enhancing Data Management Operations (DMOps)cited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.