What About the Data? A Mapping Study on Data Engineering for AI Systems
Not on the map. Why?
Abstract (arXiv)
AI systems cannot exist without data. Now that AI models (data science and AI) have matured and are readily available to apply in practice, most organizations struggle with the data infrastructure to do so. There is a growing need for data engineers that know how to prepare data for AI systems or that can setup enterprise-wide data architectures for analytical projects. But until now, the data engineering part of AI engineering has not been getting much attention, in favor of discussing the modeling part. In this paper we aim to change this by perform a mapping study on data engineering for AI systems, i.e., AI data engineering. We found 25 relevant papers between January 2019 and June 2023, explaining AI data engineering activities. We identify which life cycle phases are covered, which technical solutions or architectures are proposed and which lessons learned are presented. We end by an overall discussion of the papers with implications for practitioners and researchers. This paper creates an overview of the body of knowledge on data engineering for AI. This overview is useful for practitioners to identify solutions and best practices as well as for researchers to identify gaps.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 49 references that are in the map. First posted on arXiv 7 Feb 2024.
Builds on
12 of 49 references.
References · 12
- 2019Machine Learning Testing: Survey, Landscapes and Horizonscited by 213
- 2020Engineering AI Systems: A Research Agendacited by 37
- 2020Adoption and Effects of Software Engineering Best Practices in Machine Learningcited by 33
- 2022The Principles of Data-Centric AI (DCAI)cited by 26
- 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitionerscited by 22
- 2021On the experiences of adopting automated data validation in an industrial machine learning projectcited by 6
- 2022Data Smells in Public Datasetscited by 5
- 2022An Empirical Evaluation of Flow Based Programming in the Machine Learning Deployment Contextcited by 5
- 2022Data Smells: Categories, Causes and Consequences, and Detection of Suspicious Data in AI-based Systemscited by 4
- 2022A Compositional Approach to Creating Architecture Frameworks with an Application to Distributed AI Systemscited by 4
- 2020Data Engineering for HPC with Pythoncited by 3
- 2022Scalable Modular Synthetic Data Generation for Advancing Aerial Autonomycited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.