MLOps -- Definitions, Tools and Challenges
Not on the map. Why?
Abstract (arXiv)
This paper is an overview of the Machine Learning Operations (MLOps) area. Our aim is to define the operation and the components of such systems by highlighting the current problems and trends. In this context, we present the different tools and their usefulness in order to provide the corresponding guidelines. Moreover, the connection between MLOps and AutoML (Automated Machine Learning) is identified and how this combination could work is proposed.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 10 of its 54 references that are in the map. First posted on arXiv 1 Jan 2022.
Builds on
10 of 54 references.
References · 10
- 2020Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learningcited by 174
- 2019An Open Source AutoML Benchmarkcited by 85
- 2020Auto-PyTorch Tabular: Multi-Fidelity MetaLearning for Efficient and Robust AutoDLcited by 67
- 2020AutoML to Date and Beyond: Challenges and Opportunitiescited by 63
- 2021Who Needs MLOps: What Data Scientists Seek to Accomplish and How Can MLOps Help?cited by 37
- 2021A Data Quality-Driven View of MLOpscited by 31
- 2020Monitoring and explainability of models in productioncited by 23
- 2021MLOps Challenges in Multi-Organization Setup: Experiences from Two Real-World Casescited by 10
- 2021SensiX++: Bringing MLOPs and Multi-tenant Model Serving to Sensory Edge Devicescited by 7
- 2020The Collective Knowledge project: making ML models more portable and reproducible with open APIs, reusable best practices and MLOpscited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 12; 2024: 3; 2025: 7; 2026: 1.
25 papers.
Sort:
By area:
- 2023MLOps: A Reviewcited by 16
- 2022DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systemscited by 14
- 2023Machine Learning with Requirements: a Manifestocited by 8
- 2023MLOps for Scarce Image Data: A Use Case in Microscopic Image Analysiscited by 4
- 2023OceanBench: The Sea Surface Height Editioncited by 4
- 2025Architecting Digital Twins for Intelligent Transportation Systemscited by 3
- 2025Securing RAG: A Risk Assessment and Mitigation Frameworkcited by 3
- 2023MLHOps: Machine Learning for Healthcare Operationscited by 2
- 2023MLOps: A Step Forward to Enterprise Machine Learningcited by 2
- 2023Towards an MLOps Architecture for XAI in Industrial Applicationscited by 2
- 2023Mithridates: Auditing and Boosting Backdoor Resistance of Machine Learning Pipelinescited by 1
- 2023Extending Variability-Aware Model Selection with Bias Detection in Machine Learning Projectscited by 1
13 more
- 2024Backward Compatibility in Attributive Explanation and Enhanced Model Training Methodcited by 1
- 2024Machine Learning Operations: A Mapping Studycited by 1
- 2025End-to-End Data Quality-Driven Framework for Machine Learning in Production Environmentcited by 1
- 2022A Data Source Dependency Analysis Framework for Large Scale Data Science Projectscited by 0
- 2023Good Tools are Half the Work: Tool Usage in Deep Learning Projectscited by 0
- 2023Seeing the random forest through the decision trees. Supporting learning health systems from histopathology with machine learning models: Challenges and opportunitiescited by 0
- 2023Performance of externally validated machine learning models based on histopathology images for the diagnosis, classification, prognosis, or treatment outcome prediction in female breast cancer: A systematic reviewcited by 0
- 2024Automating Code Adaptation for MLOps -- A Benchmarking Study on LLMscited by 0
- 2025HarmonE: A Self-Adaptive Approach to Architecting Sustainable MLOpscited by 0
- 2025Getting In Contract with Large Language Models -- An Agency Theory Perspective On Large Language Model Alignmentcited by 0
- 2025Embedding the MLOps Lifecycle into OT Reference Modelscited by 0
- 2025Model Gateway: Management Platform for Model-Driven Drug Discoverycited by 0
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logisticscited by 0
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2025End-to-End Data Quality-Driven Framework for Machine Learning in Production Environment16 Dec 2025
- 2025Model Gateway: Management Platform for Model-Driven Drug Discovery5 Dec 2025
- 2025Embedding the MLOps Lifecycle into OT Reference Models23 Oct 2025
- 2025Getting In Contract with Large Language Models -- An Agency Theory Perspective On Large Language Model Alignment9 Sep 2025
- 2025HarmonE: A Self-Adaptive Approach to Architecting Sustainable MLOps19 May 2025
- 2025Securing RAG: A Risk Assessment and Mitigation Framework13 May 2025
- 2025Architecting Digital Twins for Intelligent Transportation Systems24 Feb 2025
- 2024Machine Learning Operations: A Mapping Study28 Sep 2024
- 2024Backward Compatibility in Attributive Explanation and Enhanced Model Training Method5 Aug 2024
- 2024Automating Code Adaptation for MLOps -- A Benchmarking Study on LLMs10 May 2024
- 2023Performance of externally validated machine learning models based on histopathology images for the diagnosis, classification, prognosis, or treatment outcome prediction in female breast cancer: A systematic review9 Dec 2023
13 more
- 2023Seeing the random forest through the decision trees. Supporting learning health systems from histopathology with machine learning models: Challenges and opportunities6 Dec 2023
- 2023Extending Variability-Aware Model Selection with Bias Detection in Machine Learning Projects23 Nov 2023
- 2023Good Tools are Half the Work: Tool Usage in Deep Learning Projects29 Oct 2023
- 2023OceanBench: The Sea Surface Height Edition27 Sep 2023
- 2023MLOps for Scarce Image Data: A Use Case in Microscopic Image Analysis27 Sep 2023
- 2023Towards an MLOps Architecture for XAI in Industrial Applications22 Sep 2023
- 2023MLOps: A Review19 Aug 2023
- 2023MLOps: A Step Forward to Enterprise Machine Learning27 May 2023
- 2023MLHOps: Machine Learning for Healthcare Operations4 May 2023
- 2023Machine Learning with Requirements: a Manifesto7 Apr 2023
- 2023Mithridates: Auditing and Boosting Backdoor Resistance of Machine Learning Pipelines9 Feb 2023
- 2022A Data Source Dependency Analysis Framework for Large Scale Data Science Projects15 Dec 2022
- 2022DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systems9 Nov 2022
- 2025Securing RAG: A Risk Assessment and Mitigation Frameworkcited by 3
- 2025Securing RAG: A Risk Assessment and Mitigation Framework13 May 2025
- 2023MLOps: A Reviewcited by 16
- 2022DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systemscited by 14
- 2023Machine Learning with Requirements: a Manifestocited by 8
- 2023MLOps for Scarce Image Data: A Use Case in Microscopic Image Analysiscited by 4
- 2023OceanBench: The Sea Surface Height Editioncited by 4
- 2025Architecting Digital Twins for Intelligent Transportation Systemscited by 3
- 2023MLHOps: Machine Learning for Healthcare Operationscited by 2
- 2023MLOps: A Step Forward to Enterprise Machine Learningcited by 2
- 2023Towards an MLOps Architecture for XAI in Industrial Applicationscited by 2
- 2023Mithridates: Auditing and Boosting Backdoor Resistance of Machine Learning Pipelinescited by 1
- 2023Extending Variability-Aware Model Selection with Bias Detection in Machine Learning Projectscited by 1
- 2024Backward Compatibility in Attributive Explanation and Enhanced Model Training Methodcited by 1
12 most cited of 23 All 23 (JSON)
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2025End-to-End Data Quality-Driven Framework for Machine Learning in Production Environment16 Dec 2025
- 2025Model Gateway: Management Platform for Model-Driven Drug Discovery5 Dec 2025
- 2025Embedding the MLOps Lifecycle into OT Reference Models23 Oct 2025
- 2025HarmonE: A Self-Adaptive Approach to Architecting Sustainable MLOps19 May 2025
- 2025Architecting Digital Twins for Intelligent Transportation Systems24 Feb 2025
- 2024Machine Learning Operations: A Mapping Study28 Sep 2024
- 2024Backward Compatibility in Attributive Explanation and Enhanced Model Training Method5 Aug 2024
- 2024Automating Code Adaptation for MLOps -- A Benchmarking Study on LLMs10 May 2024
- 2023Performance of externally validated machine learning models based on histopathology images for the diagnosis, classification, prognosis, or treatment outcome prediction in female breast cancer: A systematic review9 Dec 2023
- 2023Seeing the random forest through the decision trees. Supporting learning health systems from histopathology with machine learning models: Challenges and opportunities6 Dec 2023
- 2023Extending Variability-Aware Model Selection with Bias Detection in Machine Learning Projects23 Nov 2023
12 newest of 23 All 23 (JSON)