Machine Learning Operations (MLOps): Overview, Definition, and Architecture
Not on the map. Why?
Abstract (arXiv)
The final goal of all industrial machine learning (ML) projects is to develop ML products and rapidly bring them into production. However, it is highly challenging to automate and operationalize ML products and thus many ML endeavors fail to deliver on their expectations. The paradigm of Machine Learning Operations (MLOps) addresses this issue. MLOps includes several aspects, such as best practices, sets of concepts, and development culture. However, MLOps is still a vague term and its consequences for researchers and professionals are ambiguous. To address this gap, we conduct mixed-method research, including a literature review, a tool review, and expert interviews. As a result of these investigations, we provide an aggregated overview of the necessary principles, components, and roles, as well as the associated architecture and workflows. Furthermore, we furnish a definition of MLOps and highlight open challenges in the field. Finally, this work provides guidance for ML researchers and practitioners who want to automate and operate their ML products with a designated set of technologies.
Key facts. Cited by 126 papers in the map (data through 7 Oct 2026). Builds on 9 of its 67 references that are in the map. First posted on arXiv 4 May 2022.
Builds on
9 of 67 references.
References · 9
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
- 2016Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activationscited by 413
- 2021Who Needs MLOps: What Data Scientists Seek to Accomplish and How Can MLOps Help?cited by 37
- 2021A Data Quality-Driven View of MLOpscited by 31
- 2021Detecting Concept Drift With Neural Network Model Uncertaintycited by 21
- 2017SCARFF: a Scalable Framework for Streaming Credit Card Fraud Detection with Sparkcited by 14
- 2019A Survey of DevOps Concepts and Challengescited by 12
- 2021MLOps Challenges in Multi-Organization Setup: Experiences from Two Real-World Casescited by 10
- 2022Machine Learning Operations: A Survey on MLOps Tool Supportcited by 7
Built on by
Citing papers per year: 2022: 6; 2023: 27; 2024: 28; 2025: 30; 2026: 35.
126 papers.
Sort:
By area:
- 2023Continual Learning: Applications and the Road Forwardcited by 59
- 2022Data-Centric Artificial Intelligencecited by 31
- 2022A Validity Perspective on Evaluating the Justified Use of Data-driven Decision-making Algorithmscited by 30
- 2022Operationalizing Machine Learning: An Interview Studycited by 25
- 2023MLOps: A Reviewcited by 16
- 2023Towards Data-centric Graph Machine Learning: Review and Outlookcited by 15
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practicecited by 14
- 2023Efficient Neural Networks for Tiny Machine Learning: A Comprehensive Reviewcited by 9
- 2023Moderating Model Marketplaces: Platform Governance Puzzles for AI Intermediariescited by 9
- 2023Machine Learning with Requirements: a Manifestocited by 8
- 2024Continuous fake media detection: adapting deepfake detectors to new generative techniquescited by 6
- 2024On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboardscited by 6
38 more
- 2025Agentic Services Computingcited by 6
- 2022Continual-Learning-as-a-Service (CLaaS): On-Demand Efficient Adaptation of Predictive Modelscited by 5
- 2023Towards Message Brokers for Generative AI: Survey, Challenges, and Opportunitiescited by 5
- 2023Privacy-preserving machine learning for healthcare: open challenges and future perspectivescited by 4
- 2023End-User Development for Artificial Intelligence: A Systematic Literature Reviewcited by 4
- 2023MLOps for Scarce Image Data: A Use Case in Microscopic Image Analysiscited by 4
- 2023OceanBench: The Sea Surface Height Editioncited by 4
- 2024Is Your AI Truly Yours? Leveraging Blockchain for Copyrights, Provenance, and Lineagecited by 4
- 2024Adaptive Data Quality Scoring Operations Framework using Drift-Aware Mechanism for Industrial Applicationscited by 4
- 2024Towards certification: A complete statistical validation pipeline for supervised learning in industrycited by 4
- 2023ML-Based Teaching Systems: A Conceptual Frameworkcited by 3
- 2023sQUlearn -- A Python Library for Quantum Machine Learningcited by 3
- 2024XAIport: A Service Framework for the Early Adoption of XAI in AI Model Developmentcited by 3
- 2024Survey for Landing Generative AI in Social and E-commerce Recsys -- the Industry Perspectivescited by 3
- 2024Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approachcited by 3
- 2024Assessing the Auditability of AI-integrating Systems: A Framework and Learning Analytics Case Studycited by 3
- 2025Securing RAG: A Risk Assessment and Mitigation Frameworkcited by 3
- 2025Towards Secure MLOps: Surveying Attacks, Mitigation Strategies, and Research Challengescited by 3
- 2026From Prompts to Contracts: Harness Engineering for Auditable Enterprise LLM Agentscited by 3
- 2023Scalable End-to-End ML Platforms: from AutoML to Self-servecited by 2
- 2023MLHOps: Machine Learning for Healthcare Operationscited by 2
- 2023Towards Regulatable AI Systems: Technical Gaps and Policy Opportunitiescited by 2
- 2024Wasserstein Distributionally Robust Shallow Convex Neural Networkscited by 2
- 2024Adapting MLOps for Diverse In-Network Intelligence in 6G Era: Challenges and Solutionscited by 2
- 2025LoCoML: A Framework for Real-World ML Inference Pipelinescited by 2
- 2025Towards deployment-centric multimodal AI beyond vision and languagecited by 2
- 2025MLOps with Microservices: A Case Study on the Maritime Domaincited by 2
- 2025TechOps: Technical Documentation Templates for the AI Actcited by 2
- 2026The Semi-Executable Stack: Agentic Software Engineering and the Expanding Scope of SEcited by 2
- 2026A Category Theory Account of AI Identitycited by 2
- 2026The Moving Target: A Longitudinal Audit of Trust-Benchmark Score Drift Across Open-Source Chat LLM Release Linescited by 2
- 2022Capturing Dependencies within Machine Learning via a Formal Process Modelcited by 1
- 2023Mithridates: Auditing and Boosting Backdoor Resistance of Machine Learning Pipelinescited by 1
- 2023Self-Improving-Leaderboard(SIL): A Call for Real-World Centric Natural Language Processing Leaderboardscited by 1
- 2023A Comprehensive Study of Groundbreaking Machine Learning Research: Analyzing highly cited and impactful publications across six decadescited by 1
- 2023On-Premise AIOps Infrastructure for a Software Editor SME: An Experience Reportcited by 1
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Researchcited by 1
- 2024A Framework to Model ML Engineering Processescited by 1
50 most cited of 126 All 126 (JSON)
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2026Convex AI Compositionality and the Governance of AI System Populations21 Sep 2026
- 2026Autonomous Model Lifecycle Management for Digital Twin-Based Manufacturing Control19 Sep 2026
- 2026AI Exposure and AI Resilience: A Two-Dimensional Assessment Framework for Software and Software-Based Business Model10 Sep 2026
- 2026Candidate Comparability Before Promotion: Conditional Validation in Adaptive Network Intrusion Detection3 Sep 2026
- 2026Forward-Deployed Full-Stack Engineering for Autonomous Cloud MLOps30 Aug 2026
- 2026Can Coding Agents Build Robust Baselines? A Skill-Based Approach for Automating the Medical Imaging Model-Development Pipeline24 Aug 2026
- 2026AmalthAI: An Open-Source Computer Vision Platform for Cultural Heritage13 Aug 2026
- 2026Backward Compatibility in Tree-Based Explanations and Enhanced CART Algorithm9 Aug 2026
- 2026From Siloed Algorithms to Compliance-First Agentic Platforms: A Multi-Layered Architecture for Hospital AI Systems6 Aug 2026
- 2026A Security-Oriented Lifecycle Model for Large Language Model Systems4 Aug 2026
- 2026DataFlow-Harness: A Grounded Code-Agent Platform for Constructing Editable LLM Data Pipelines18 Jul 2026
38 more
- 2026A Methodology for Auditable Trustworthiness Levels in AI Lifecycle Governance17 Jul 2026
- 2026How Do Practitioners Build SE Agents? Insights from a Mixed-Methods Study12 Jul 2026
- 2026From Prompts to Contracts: Harness Engineering for Auditable Enterprise LLM Agents9 Jul 2026
- 2026SAREF-based Ontology for Distributed AI Workflows across the Edge-Fog-Cloud Continuum7 Jul 2026
- 2026The Moving Target: A Longitudinal Audit of Trust-Benchmark Score Drift Across Open-Source Chat LLM Release Lines1 Jul 2026
- 2026A Category Theory Account of AI Identity30 Jun 2026
- 2026Trustworthy Self-Composable Big-Data-as-a-Service: An LLM-Orchestrated Multi-Agent Framework for Automated Data Engineering, AutoML, MLOps Deployment, and Drift-Aware Lifecycle Optimization16 Jun 2026
- 2026GRACE-DS: a Guarded Reward-guided Agent Correction Environment in Data Science14 Jun 2026
- 2026GovAI-Pipe: A Layered AI Governance Pipeline for Citizen-Facing AI in Turkey's e-Government Gateway31 May 2026
- 2026Operational AI Deployment Assurance: Governance-State Orchestration Under Threshold-Sensitive Deployment Conditions -- A Governance Framework for High-Stakes AI Systems27 May 2026
- 2026Towards Evaluation Engineering: An Empirical Study of ML Evaluation Harnesses in the Wild22 May 2026
- 2026A Five-Layer MLOps Architecture for Connected Automated Driving12 May 2026
- 2026Update Opacity: Epistemic Accessibility and Governance Under AI System Change27 Apr 2026
- 2026The Semi-Executable Stack: Agentic Software Engineering and the Expanding Scope of SE16 Apr 2026
- 2026UGAF-ITS: A Standards Harmonization Framework and Validation Tool for Multi-Framework AI Governance in Distributed Intelligent Transportation Systems7 Apr 2026
- 2026RAD-AI: Rethinking Architecture Documentation for AI-Augmented Ecosystems30 Mar 2026
- 2026Evaluating Small Language Models for Front-Door Routing: A Harmonized Benchmark and Synthetic-Traffic Experiment26 Mar 2026
- 2026Herding CATs: ALARA for Agent Harness Engineering in Portable Composable Multi-Agent Teams20 Mar 2026
- 2026WORKSWORLD: A Domain for Integrated Numeric Planning and Scheduling of Distributed Pipelined Workflows12 Mar 2026
- 2026Ethical and Explainable AI in Reusable MLOps Pipelines15 Feb 2026
- 2026Engineering AI Agents for Clinical Workflows: A Case Study in Architecture,MLOps, and Governance31 Jan 2026
- 2026Exploring Human-in-the-Loop Themes in AI Application Development: An Empirical Thematic Analysis18 Jan 2026
- 2026The Machine Learning Canvas: Empirical Findings on Why Strategy Matters More Than AI Code Generation5 Jan 2026
- 2025Training a Huggingface Model on AWS Sagemaker (Without Tears)30 Dec 2025
- 2025PDx -- Adaptive Credit Risk Forecasting Model in Digital Lending using Machine Learning Operations26 Dec 2025
- 2025AI Application Operations -- A Socio-Technical Framework for Data-driven Organizations23 Dec 2025
- 2025End-to-End Data Quality-Driven Framework for Machine Learning in Production Environment16 Dec 2025
- 2025Optimal Resource Allocation for ML Model Training and Deployment under Concept Drift14 Dec 2025
- 2025A Multi-Criteria Automated MLOps Pipeline for Cost-Effective Cloud-Based Classifier Retraining in Response to Data Distribution Shifts12 Dec 2025
- 2025Ariel-ML: Computing Parallelization with Embedded Rust for Neural Networks on Heterogeneous Multi-core Microcontrollers10 Dec 2025
- 2025Reusability in MLOps: Leveraging Ports and Adapters to Build a Microservices Architecture for the Maritime Domain9 Dec 2025
- 2025Enhancing Transparency and Traceability in Healthcare AI: The AI Product Passport4 Dec 2025
- 2025The Double-Edged Nature of the Rashomon Set for Trustworthy Machine Learning26 Nov 2025
- 2025Mirror, Mirror on the Wall -- Which is the Best Model of Them All?25 Nov 2025
- 2025A Configuration-First Framework for Reproducible, Low-Code Machine Learning: a Localization Use Case29 Oct 2025
- 2025Scalable GPU-Based Integrity Verification for Large Machine Learning Models27 Oct 2025
- 2025Embedding the MLOps Lifecycle into OT Reference Models23 Oct 2025
- 2025Agentic Services Computing29 Sep 2025
50 newest of 126 All 126 (JSON)
- 2025Agentic Services Computingcited by 6
- 2026From Prompts to Contracts: Harness Engineering for Auditable Enterprise LLM Agentscited by 3
- 2026The Semi-Executable Stack: Agentic Software Engineering and the Expanding Scope of SEcited by 2
- 2026How Do Practitioners Build SE Agents? Insights from a Mixed-Methods Studycited by 1
- 2026DataFlow-Harness: A Grounded Code-Agent Platform for Constructing Editable LLM Data Pipelinescited by 1
- 2026GRACE-DS: a Guarded Reward-guided Agent Correction Environment in Data Sciencecited by 0
- 2026Trustworthy Self-Composable Big-Data-as-a-Service: An LLM-Orchestrated Multi-Agent Framework for Automated Data Engineering, AutoML, MLOps Deployment, and Drift-Aware Lifecycle Optimizationcited by 0
- 2026Can Coding Agents Build Robust Baselines? A Skill-Based Approach for Automating the Medical Imaging Model-Development Pipelinecited by 0
- 2026Can Coding Agents Build Robust Baselines? A Skill-Based Approach for Automating the Medical Imaging Model-Development Pipeline24 Aug 2026
- 2026DataFlow-Harness: A Grounded Code-Agent Platform for Constructing Editable LLM Data Pipelines18 Jul 2026
- 2026How Do Practitioners Build SE Agents? Insights from a Mixed-Methods Study12 Jul 2026
- 2026From Prompts to Contracts: Harness Engineering for Auditable Enterprise LLM Agents9 Jul 2026
- 2026Trustworthy Self-Composable Big-Data-as-a-Service: An LLM-Orchestrated Multi-Agent Framework for Automated Data Engineering, AutoML, MLOps Deployment, and Drift-Aware Lifecycle Optimization16 Jun 2026
- 2026GRACE-DS: a Guarded Reward-guided Agent Correction Environment in Data Science14 Jun 2026
- 2026The Semi-Executable Stack: Agentic Software Engineering and the Expanding Scope of SE16 Apr 2026
- 2025Agentic Services Computing29 Sep 2025
- 2025Securing RAG: A Risk Assessment and Mitigation Frameworkcited by 3
- 2025Securing RAG: A Risk Assessment and Mitigation Framework13 May 2025
- 2023Continual Learning: Applications and the Road Forwardcited by 59
- 2022Data-Centric Artificial Intelligencecited by 31
- 2022A Validity Perspective on Evaluating the Justified Use of Data-driven Decision-making Algorithmscited by 30
- 2022Operationalizing Machine Learning: An Interview Studycited by 25
- 2023MLOps: A Reviewcited by 16
- 2023Towards Data-centric Graph Machine Learning: Review and Outlookcited by 15
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practicecited by 14
- 2023Efficient Neural Networks for Tiny Machine Learning: A Comprehensive Reviewcited by 9
- 2023Moderating Model Marketplaces: Platform Governance Puzzles for AI Intermediariescited by 9
- 2023Machine Learning with Requirements: a Manifestocited by 8
- 2024Continuous fake media detection: adapting deepfake detectors to new generative techniquescited by 6
- 2024On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboardscited by 6
12 most cited of 115 All 115 (JSON)
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2026Convex AI Compositionality and the Governance of AI System Populations21 Sep 2026
- 2026Autonomous Model Lifecycle Management for Digital Twin-Based Manufacturing Control19 Sep 2026
- 2026AI Exposure and AI Resilience: A Two-Dimensional Assessment Framework for Software and Software-Based Business Model10 Sep 2026
- 2026Candidate Comparability Before Promotion: Conditional Validation in Adaptive Network Intrusion Detection3 Sep 2026
- 2026Forward-Deployed Full-Stack Engineering for Autonomous Cloud MLOps30 Aug 2026
- 2026AmalthAI: An Open-Source Computer Vision Platform for Cultural Heritage13 Aug 2026
- 2026Backward Compatibility in Tree-Based Explanations and Enhanced CART Algorithm9 Aug 2026
- 2026From Siloed Algorithms to Compliance-First Agentic Platforms: A Multi-Layered Architecture for Hospital AI Systems6 Aug 2026
- 2026A Security-Oriented Lifecycle Model for Large Language Model Systems4 Aug 2026
- 2026A Methodology for Auditable Trustworthiness Levels in AI Lifecycle Governance17 Jul 2026
- 2026SAREF-based Ontology for Distributed AI Workflows across the Edge-Fog-Cloud Continuum7 Jul 2026
12 newest of 115 All 115 (JSON)