Studying Software Engineering Patterns for Designing Machine Learning Systems
Not on the map. Why?
Abstract (arXiv)
Machine-learning (ML) techniques have become popular in the recent years. ML techniques rely on mathematics and on software engineering. Researchers and practitioners studying best practices for designing ML application systems and software to address the software complexity and quality of ML techniques. Such design practices are often formalized as architecture patterns and design patterns by encapsulating reusable solutions to commonly occurring problems within given contexts. However, to the best of our knowledge, there has been no work collecting, classifying, and discussing these software-engineering (SE) design patterns for ML techniques systematically. Thus, we set out to collect good/bad SE design patterns for ML techniques to provide developers with a comprehensive and ordered classification of such patterns. We report here preliminary results of a systematic-literature review (SLR) of good/bad design patterns for ML.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 7; 2023: 4; 2024: 3; 2025: 0; 2026: 3.
24 papers.
Sort:
By area:
- 2021Software Engineering for AI-Based Systems: A Surveycited by 68
- 2021How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Studycited by 29
- 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitionerscited by 22
- 2021Characterizing Technical Debt and Antipatterns in AI-Based Systems: A Systematic Mapping Studycited by 21
- 2021Architectural Patterns for the Design of Federated Learning Systemscited by 17
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practicecited by 14
- 2022Prescriptive and Descriptive Approaches to Machine-Learning Transparencycited by 7
- 2022Quality issues in Machine Learning Software Systemscited by 7
- 2021An Experience Report on Machine Learning Reproducibility: Guidance for Practitioners and TensorFlow Model Garden Contributorscited by 6
- 2022Towards a Change Taxonomy for Machine Learning Systemscited by 6
- 2021Machine Learning Model Development from a Software Engineering Perspective: A Systematic Literature Reviewcited by 4
- 2022A Compositional Approach to Creating Architecture Frameworks with an Application to Distributed AI Systemscited by 4
12 more
- 2023Design Patterns for AI-based Systems: A Multivocal Literature Review and Pattern Repositorycited by 4
- 2024Generating a Low-code Complete Workflow via Task Decomposition and RAGcited by 3
- 2022"Project smells" -- Experiences in Analysing the Software Quality of ML Projects with mllintcited by 2
- 2022Assessing the Quality of Computational Notebooks for a Frictionless Transition from Exploration to Productioncited by 1
- 2021Color Teams for Machine Learning Developmentcited by 0
- 2022Topical: Learning Repository Embeddings from Source Code using Attentioncited by 0
- 2023Quality Issues in Machine Learning Software Systemscited by 0
- 2024How do Machine Learning Projects use Continuous Integration Practices? An Empirical Study on GitHub Actionscited by 0
- 2024The Impact of Environment Configurations on the Stability of AI-Enabled Systemscited by 0
- 2026Architecturally Significant MLOps Guidelines for ML Model Integration and Deployment: a Gray Literature Reviewcited by 0
- 2026From AI Technical Debt to Agentic Technical Debt: A Systematic Mapping of Root Causes and Manifestations in Agentic AI Systemscited by 0
- 2026Software Engineering for AI-driven Building Operationcited by 0
- 2026Software Engineering for AI-driven Building Operation17 Aug 2026
- 2026From AI Technical Debt to Agentic Technical Debt: A Systematic Mapping of Root Causes and Manifestations in Agentic AI Systems2 Aug 2026
- 2026Architecturally Significant MLOps Guidelines for ML Model Integration and Deployment: a Gray Literature Review3 Jun 2026
- 2024Generating a Low-code Complete Workflow via Task Decomposition and RAG29 Nov 2024
- 2024The Impact of Environment Configurations on the Stability of AI-Enabled Systems5 Aug 2024
- 2024How do Machine Learning Projects use Continuous Integration Practices? An Empirical Study on GitHub Actions14 Mar 2024
- 2023Quality Issues in Machine Learning Software Systems26 Jun 2023
- 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitioners31 Mar 2023
- 2023Design Patterns for AI-based Systems: A Multivocal Literature Review and Pattern Repository23 Mar 2023
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practice21 Jan 2023
- 2022A Compositional Approach to Creating Architecture Frameworks with an Application to Distributed AI Systems27 Dec 2022
- 2022Topical: Learning Repository Embeddings from Source Code using Attention19 Aug 2022
12 more
- 2022Quality issues in Machine Learning Software Systems18 Aug 2022
- 2022Assessing the Quality of Computational Notebooks for a Frictionless Transition from Exploration to Production24 May 2022
- 2022Prescriptive and Descriptive Approaches to Machine-Learning Transparency27 Apr 2022
- 2022Towards a Change Taxonomy for Machine Learning Systems21 Mar 2022
- 2022"Project smells" -- Experiences in Analysing the Software Quality of ML Projects with mllint20 Jan 2022
- 2021Color Teams for Machine Learning Development20 Oct 2021
- 2021An Experience Report on Machine Learning Reproducibility: Guidance for Practitioners and TensorFlow Model Garden Contributors2 Jul 2021
- 2021Software Engineering for AI-Based Systems: A Survey5 May 2021
- 2021Characterizing Technical Debt and Antipatterns in AI-Based Systems: A Systematic Mapping Study17 Mar 2021
- 2021Machine Learning Model Development from a Software Engineering Perspective: A Systematic Literature Review15 Feb 2021
- 2021How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study13 Jan 2021
- 2021Architectural Patterns for the Design of Federated Learning Systems7 Jan 2021
- 2021Software Engineering for AI-Based Systems: A Surveycited by 68
- 2021How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Studycited by 29
- 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitionerscited by 22
- 2021Characterizing Technical Debt and Antipatterns in AI-Based Systems: A Systematic Mapping Studycited by 21
- 2021Architectural Patterns for the Design of Federated Learning Systemscited by 17
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practicecited by 14
- 2022Prescriptive and Descriptive Approaches to Machine-Learning Transparencycited by 7
- 2022Quality issues in Machine Learning Software Systemscited by 7
- 2021An Experience Report on Machine Learning Reproducibility: Guidance for Practitioners and TensorFlow Model Garden Contributorscited by 6
- 2022Towards a Change Taxonomy for Machine Learning Systemscited by 6
- 2021Machine Learning Model Development from a Software Engineering Perspective: A Systematic Literature Reviewcited by 4
- 2022A Compositional Approach to Creating Architecture Frameworks with an Application to Distributed AI Systemscited by 4
12 most cited of 23 All 23 (JSON)
- 2026Software Engineering for AI-driven Building Operation17 Aug 2026
- 2026Architecturally Significant MLOps Guidelines for ML Model Integration and Deployment: a Gray Literature Review3 Jun 2026
- 2024Generating a Low-code Complete Workflow via Task Decomposition and RAG29 Nov 2024
- 2024The Impact of Environment Configurations on the Stability of AI-Enabled Systems5 Aug 2024
- 2024How do Machine Learning Projects use Continuous Integration Practices? An Empirical Study on GitHub Actions14 Mar 2024
- 2023Quality Issues in Machine Learning Software Systems26 Jun 2023
- 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitioners31 Mar 2023
- 2023Design Patterns for AI-based Systems: A Multivocal Literature Review and Pattern Repository23 Mar 2023
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practice21 Jan 2023
- 2022A Compositional Approach to Creating Architecture Frameworks with an Application to Distributed AI Systems27 Dec 2022
- 2022Topical: Learning Repository Embeddings from Source Code using Attention19 Aug 2022
- 2022Quality issues in Machine Learning Software Systems18 Aug 2022
12 newest of 23 All 23 (JSON)