mlsanityData to 7 Oct 2026

DMOps: Data Management Operation and Recipes

arXiv 2301.01228 ↗First posted 2 Jan 2023cs.DB cs.LG stat.MEcited by 7

Not on the map. Why?

Abstract (arXiv)

Data-centric AI has shed light on the significance of data within the machine learning (ML) pipeline. Recognizing its significance, academia, industry, and government departments have suggested various NLP data research initiatives. While the ability to utilize existing data is essential, the ability to build a dataset has become more critical than ever, especially in the industry. In consideration of this trend, we propose a "Data Management Operations and Recipes" to guide the industry in optimizing the building of datasets for NLP products. This paper presents the concept of DMOps which is derived from real-world experiences with NLP data management and aims to streamline data operations by offering a baseline.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 18 of its 55 references that are in the map. First posted on arXiv 2 Jan 2023.

Builds on

18 of 55 references.

References · 18

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  5. 2021Datasets: A Community Library for Natural Language Processingcited by 526
  6. 2021A Survey of Human-in-the-loop for Machine Learningcited by 214
  7. 2018A Survey on Data Collection for Machine Learning: a Big Data -- AI Integration Perspectivecited by 111
  8. 2019Neural Machine Translation: A Review and Surveycited by 99
  9. 2020TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Taskcited by 96
  10. 2022DataPerf: Benchmarks for Data-Centric AI Developmentcited by 89
  11. 2022POTATO: The Portable Text Annotation Toolcited by 64
  12. 2021Generate, Annotate, and Learn: NLP with Synthetic Textcited by 42
6 more
  1. 2021What can Data-Centric AI Learn from Data and ML Engineering?cited by 24
  2. 2021LightTag: Text Annotation Platformcited by 16
  3. 2021A Large-Scale Dataset for Benchmarking Elevator Button Segmentation and Character Recognitioncited by 3
  4. 2021How should human translation coexist with NMT? Efficient tool for building high quality parallel corpuscited by 3
  5. 2020Enterprise AI Canvas -- Integrating Artificial Intelligence into Businesscited by 1
  6. 2022Can Artificial Intelligence Transform DevOps?cited by 1

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 3; 2025: 1.

7 papers.

  1. 2024Advancing Post-OCR Correction: A Comparative Study of Synthetic Datacited by 8
  2. 2023Inter-Annotator Agreement in the Wild: Uncovering Its Emerging Roles and Considerations in Real-World Scenarioscited by 4
  3. 2023Transcending Traditional Boundaries: Leveraging Inter-Annotator Agreement (IAA) for Enhancing Data Management Operations (DMOps)cited by 1
  4. 2024Model-Based Data-Centric AI: Bridging the Divide Between Academic Ideals and Industrial Pragmatismcited by 1
  5. 2024Dataverse: Open-Source ETL (Extract, Transform, Load) Pipeline for Large Language Modelscited by 1
  6. 2023Synthetic Alone: Exploring the Dark Side of Synthetic Data for Grammatical Error Correctioncited by 0
  7. 2025Modeling User-System Behavior for Training-free Building of Private Domain Conversational Agentscited by 0