mlsanityData to 7 Oct 2026

Characterizing Technical Debt and Antipatterns in AI-Based Systems: A Systematic Mapping Study

arXiv 2103.09783 ↗First posted 17 Mar 2021cs.SE cs.AI cs.LGcited by 21

Not on the map. Why?

Abstract (arXiv)

Background: With the rising popularity of Artificial Intelligence (AI), there is a growing need to build large and complex AI-based systems in a cost-effective and manageable way. Like with traditional software, Technical Debt (TD) will emerge naturally over time in these systems, therefore leading to challenges and risks if not managed appropriately. The influence of data science and the stochastic nature of AI-based systems may also lead to new types of TD or antipatterns, which are not yet fully understood by researchers and practitioners. Objective: The goal of our study is to provide a clear overview and characterization of the types of TD (both established and new ones) that appear in AI-based systems, as well as the antipatterns and related solutions that have been proposed. Method: Following the process of a systematic mapping study, 21 primary studies are identified and analyzed. Results: Our results show that (i) established TD types, variations of them, and four new TD types (data, model, configuration, and ethics debt) are present in AI-based systems, (ii) 72 antipatterns are discussed in the literature, the majority related to data and model deficiencies, and (iii) 46 solutions have been proposed, either to address specific TD types, antipatterns, or TD in general. Conclusions: Our results can support AI professionals with reasoning about and communicating aspects of TD present in their systems. Additionally, they can serve as a foundation for future research to further our understanding of TD in AI-based systems.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 13 of its 55 references that are in the map. First posted on arXiv 17 Mar 2021.

Builds on

13 of 55 references.

References · 13

  1. 2019Taxonomy of Real Faults in Deep Learning Systemscited by 90
  2. 2018Software Engineering Challenges of Deep Learningcited by 41
  3. 2020Engineering AI Systems: A Research Agendacited by 37
  4. 2020Adoption and Effects of Software Engineering Best Practices in Machine Learningcited by 33
  5. 2019Studying Software Engineering Patterns for Designing Machine Learning Systemscited by 24
  6. 2019Requirements Engineering Challenges in Building AI-Based Complex Systemscited by 21
  7. 2021Quality Assurance for AI-based Systems: Overview and Challengescited by 19
  8. 2020Towards Guidelines for Assessing Qualities of Machine Learning Systemscited by 16
  9. 2019Machine Learning Software Engineering in Practice: An Industrial Case Studycited by 12
  10. 2020Quality Management of Machine Learning Systemscited by 6
  11. 2019Technical Debt in Data-Intensive Software Systemscited by 3
  12. 2019Component Mismatches Are a Critical Bottleneck to Fielding AI-Enabled Systems in the Public Sectorcited by 2
1 more
  1. 2018Prioritizing Technical Debt in Database Normalization Using Portfolio Theory and Data Quality Metricscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 6; 2023: 5; 2024: 3; 2025: 2; 2026: 5.

21 papers.

Sort:

By area:

  1. 2023Analyzing the Evolution and Maintenance of ML Models on Hugging Facecited by 22
  2. 2025Vibe Coding as a Reconfiguration of Intent Mediation in Software Development: Definition, Implications, and Research Agendacited by 13
  3. 2022Model-Free Generative Replay for Lifelong Reinforcement Learning: Application to Starcraft-2cited by 11
  4. 2022Quality issues in Machine Learning Software Systemscited by 7
  5. 2024Maintainability Challenges in ML: A Systematic Literature Reviewcited by 5
  6. 2022Data Smells: Categories, Causes and Consequences, and Detection of Suspicious Data in AI-based Systemscited by 4
  7. 2023Design Patterns for AI-based Systems: A Multivocal Literature Review and Pattern Repositorycited by 4
  8. 2022System Design for an Integrated Lifelong Reinforcement Learning Agent for Real-Time Strategy Gamescited by 3
  9. 2023Towards green AI-based software systems: an architecture-centric approach (GAISSA)cited by 3
  10. 2024How do Machine Learning Models Change?cited by 3
  11. 2022"Project smells" -- Experiences in Analysing the Software Quality of ML Projects with mllintcited by 2
  12. 2022Assessing the Quality of Computational Notebooks for a Frictionless Transition from Exploration to Productioncited by 1
9 more
  1. 2025How Do Model Export Formats Impact the Development of ML-Enabled Systems? A Case Study on Model Integrationcited by 1
  2. 2026Using Small Language Models to Reverse-Engineer Machine Learning Pipelines Structurescited by 1
  3. 2023A Case Study on AI Engineering Practices: Developing an Autonomous Stock Trading Systemcited by 0
  4. 2023Quality Issues in Machine Learning Software Systemscited by 0
  5. 2024The Impact of Environment Configurations on the Stability of AI-Enabled Systemscited by 0
  6. 2026RAD-AI: Rethinking Architecture Documentation for AI-Augmented Ecosystemscited by 0
  7. 2026Data-aware Static Analysis: Improving Detection of Semantic Faults in Machine Learning Code Using Data Characteristicscited by 0
  8. 2026From AI Technical Debt to Agentic Technical Debt: A Systematic Mapping of Root Causes and Manifestations in Agentic AI Systemscited by 0
  9. 2026Studying, Identifying, and Fixing Hidden Technical Debt in AI-Intensive Cyber-Physical Systemscited by 0