mlsanityData to 14 Oct 2026

Design Patterns for AI-based Systems: A Multivocal Literature Review and Pattern Repository

arXiv 2303.13173 ↗First posted 23 Mar 2023cs.SE cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Systems with artificial intelligence components, so-called AI-based systems, have gained considerable attention recently. However, many organizations have issues with achieving production readiness with such systems. As a means to improve certain software quality attributes and to address frequently occurring problems, design patterns represent proven solution blueprints. While new patterns for AI-based systems are emerging, existing patterns have also been adapted to this new context. The goal of this study is to provide an overview of design patterns for AI-based systems, both new and adapted ones. We want to collect and categorize patterns, and make them accessible for researchers and practitioners. To this end, we first performed a multivocal literature review (MLR) to collect design patterns used with AI-based systems. We then integrated the created pattern collection into a web-based pattern repository to make the patterns browsable and easy to find. As a result, we selected 51 resources (35 white and 16 gray ones), from which we extracted 70 unique patterns used for AI-based systems. Among these are 34 new patterns and 36 traditional ones that have been adapted to this context. Popular pattern categories include "architecture" (25 patterns), "deployment" (16), "implementation" (9), or "security & safety" (9). While some patterns with four or more mentions already seem established, the majority of patterns have only been mentioned once or twice (51 patterns). Our results in this emerging field can be used by researchers as a foundation for follow-up studies and by practitioners to discover relevant patterns for informing the design of AI-based systems.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 11 of its 57 references that are in the map. First posted on arXiv 23 Mar 2023.

Builds on

11 of 57 references.

References · 11

  1. 2021Software Engineering for AI-Based Systems: A Surveycited by 69
  2. 2017Guidelines for including grey literature and conducting multivocal literature reviews in software engineeringcited by 41
  3. 2020Engineering AI Systems: A Research Agendacited by 37
  4. 2019Studying Software Engineering Patterns for Designing Machine Learning Systemscited by 24
  5. 2021Characterizing Technical Debt and Antipatterns in AI-Based Systems: A Systematic Mapping Studycited by 21
  6. 2021Adapting Software Architectures to Machine Learning Challengescited by 11
  7. 2021MLOps Challenges in Multi-Organization Setup: Experiences from Two Real-World Casescited by 10
  8. 2019Continuous Integration of Machine Learning Models with ease.ml/ci: Towards a Rigorous Yet Practical Treatmentcited by 9
  9. 2021Software Engineering for Responsible AI: An Empirical Study and Operationalised Patternscited by 9
  10. 2022Responsible-AI-by-Design: a Pattern Collection for Designing Responsible AI Systemscited by 4
  11. 2022Towards a Reference Software Architecture for Human-AI Teaming in Smart Manufacturingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 0; 2026: 2.

4 papers.