Who Needs MLOps: What Data Scientists Seek to Accomplish and How Can MLOps Help?
Not on the map. Why?
Abstract (arXiv)
Following continuous software engineering practices, there has been an increasing interest in rapid deployment of machine learning (ML) features, called MLOps. In this paper, we study the importance of MLOps in the context of data scientists' daily activities, based on a survey where we collected responses from 331 professionals from 63 different countries in ML domain, indicating on what they were working on in the last three months. Based on the results, up to 40% respondents say that they work with both models and infrastructure; the majority of the work revolves around relational and time series data; and the largest categories of problems to be solved are predictive analysis, time series data, and computer vision. The biggest perceived problems revolve around data, although there is some awareness of problems related to deploying models to production and related procedures. To hypothesise, we believe that organisations represented in the survey can be divided to three categories -- (i) figuring out how to best use data; (ii) focusing on building the first models and getting them to production; and (iii) managing several models, their versions and training datasets, as well as retraining and frequent deployment of retrained models. In the results, the majority of respondents are in category (i) or (ii), focusing on data and models; however the benefits of MLOps only emerge in category (iii) when there is a need for frequent retraining and redeployment. Hence, setting up an MLOps pipeline is a natural step to take, when an organization takes the step from ML as a proof-of-concept to ML as a part of nominal activities.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Mar 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 10; 2023: 11; 2024: 8; 2025: 3; 2026: 1.
37 papers.
Sort:
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2022Machine Learning Operations (MLOps): Overview, Definition, and Architecturecited by 126
- 2021Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Processcited by 56
- 2022Sensible AI: Re-imagining Interpretability and Explainability using Sensemaking Theorycited by 32
- 2022MLOps -- Definitions, Tools and Challengescited by 25
- 2022Operationalizing Machine Learning: An Interview Studycited by 25
- 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitionerscited by 22
- 2023MLOps: A Reviewcited by 16
- 2022DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systemscited by 14
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practicecited by 14
- 2023Overcoming the Stability Gap in Continual Learningcited by 13
- 2022A Human-Centric Take on Model Monitoringcited by 9
25 more
- 2023Machine Learning with Requirements: a Manifestocited by 8
- 2022Putting AI Ethics into Practice: The Hourglass Model of Organizational AI Governancecited by 6
- 2022Capabilities for Better ML Engineeringcited by 3
- 2024Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approachcited by 3
- 2025Towards Secure MLOps: Surveying Attacks, Mitigation Strategies, and Research Challengescited by 3
- 2021Disease Progression Modeling Workbench 360cited by 2
- 2022A Preliminary Investigation of MLOps Practices in GitHubcited by 2
- 2023Scalable End-to-End ML Platforms: from AutoML to Self-servecited by 2
- 2023MLHOps: Machine Learning for Healthcare Operationscited by 2
- 2023MLOps: A Step Forward to Enterprise Machine Learningcited by 2
- 2023Measuring Distributional Shifts in Text: The Advantage of Language Model-Based Embeddingscited by 2
- 2024Towards MLOps: A DevOps Tools Recommender System for Machine Learning Systemcited by 2
- 2022Designing an Efficient End-to-end Machine Learning Pipeline for Real-time Empty-shelf Detectioncited by 1
- 2023AI for Agile development: a Meta-Analysiscited by 1
- 2024Exploratory Visual Analysis for Increasing Data Readiness in Artificial Intelligence Projectscited by 1
- 2024OML-AD: Online Machine Learning for Anomaly Detection in Time Series Datacited by 1
- 2024Machine Learning Operations: A Mapping Studycited by 1
- 2021Opportunities for Machine Learning to Accelerate Halide Perovskite Commercialization and Scale-Upcited by 0
- 2023MLOps with enhanced performance control and observabilitycited by 0
- 2024Machine Learning Techniques for MRI Data Processing at Expanding Scalecited by 0
- 2024Automating Code Adaptation for MLOps -- A Benchmarking Study on LLMscited by 0
- 2025Addressing Quality Challenges in Deep Learning: The Role of MLOps and Domain Knowledgecited by 0
- 2024GenAIOps for GenAI Model-Agilitycited by 0
- 2025Proposing a Framework for Machine Learning Adoption on Legacy Systemscited by 0
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logisticscited by 0
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2025Proposing a Framework for Machine Learning Adoption on Legacy Systems29 Sep 2025
- 2025Towards Secure MLOps: Surveying Attacks, Mitigation Strategies, and Research Challenges30 May 2025
- 2025Addressing Quality Challenges in Deep Learning: The Role of MLOps and Domain Knowledge14 Jan 2025
- 2024GenAIOps for GenAI Model-Agility19 Dec 2024
- 2024Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach28 Oct 2024
- 2024Machine Learning Operations: A Mapping Study28 Sep 2024
- 2024OML-AD: Online Machine Learning for Anomaly Detection in Time Series Data15 Sep 2024
- 2024Exploratory Visual Analysis for Increasing Data Readiness in Artificial Intelligence Projects5 Sep 2024
- 2024Automating Code Adaptation for MLOps -- A Benchmarking Study on LLMs10 May 2024
- 2024Machine Learning Techniques for MRI Data Processing at Expanding Scale22 Apr 2024
- 2024Towards MLOps: A DevOps Tools Recommender System for Machine Learning System20 Feb 2024
25 more
- 2023Measuring Distributional Shifts in Text: The Advantage of Language Model-Based Embeddings4 Dec 2023
- 2023MLOps: A Review19 Aug 2023
- 2023Overcoming the Stability Gap in Continual Learning2 Jun 2023
- 2023MLOps: A Step Forward to Enterprise Machine Learning27 May 2023
- 2023AI for Agile development: a Meta-Analysis14 May 2023
- 2023MLHOps: Machine Learning for Healthcare Operations4 May 2023
- 2023Machine Learning with Requirements: a Manifesto7 Apr 2023
- 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitioners31 Mar 2023
- 2023Scalable End-to-End ML Platforms: from AutoML to Self-serve27 Feb 2023
- 2023MLOps with enhanced performance control and observability2 Feb 2023
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practice21 Jan 2023
- 2022Capabilities for Better ML Engineering11 Nov 2022
- 2022DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systems9 Nov 2022
- 2022A Preliminary Investigation of MLOps Practices in GitHub23 Sep 2022
- 2022Operationalizing Machine Learning: An Interview Study16 Sep 2022
- 2022A Human-Centric Take on Model Monitoring6 Jun 2022
- 2022Putting AI Ethics into Practice: The Hourglass Model of Organizational AI Governance1 Jun 2022
- 2022Designing an Efficient End-to-end Machine Learning Pipeline for Real-time Empty-shelf Detection25 May 2022
- 2022Sensible AI: Re-imagining Interpretability and Explainability using Sensemaking Theory10 May 2022
- 2022Machine Learning Operations (MLOps): Overview, Definition, and Architecture4 May 2022
- 2022MLOps -- Definitions, Tools and Challenges1 Jan 2022
- 2021Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Process19 Oct 2021
- 2021Opportunities for Machine Learning to Accelerate Halide Perovskite Commercialization and Scale-Up8 Oct 2021
- 2021Trustworthy AI: From Principles to Practices4 Oct 2021
- 2021Disease Progression Modeling Workbench 36024 Jun 2021
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2022Machine Learning Operations (MLOps): Overview, Definition, and Architecturecited by 126
- 2021Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Processcited by 56
- 2022Sensible AI: Re-imagining Interpretability and Explainability using Sensemaking Theorycited by 32
- 2022MLOps -- Definitions, Tools and Challengescited by 25
- 2022Operationalizing Machine Learning: An Interview Studycited by 25
- 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitionerscited by 22
- 2023MLOps: A Reviewcited by 16
- 2022DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systemscited by 14
- 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practicecited by 14
- 2023Overcoming the Stability Gap in Continual Learningcited by 13
- 2022A Human-Centric Take on Model Monitoringcited by 9
12 most cited of 37 All 37 (JSON)
- 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics1 Oct 2026
- 2025Proposing a Framework for Machine Learning Adoption on Legacy Systems29 Sep 2025
- 2025Towards Secure MLOps: Surveying Attacks, Mitigation Strategies, and Research Challenges30 May 2025
- 2025Addressing Quality Challenges in Deep Learning: The Role of MLOps and Domain Knowledge14 Jan 2025
- 2024GenAIOps for GenAI Model-Agility19 Dec 2024
- 2024Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach28 Oct 2024
- 2024Machine Learning Operations: A Mapping Study28 Sep 2024
- 2024OML-AD: Online Machine Learning for Anomaly Detection in Time Series Data15 Sep 2024
- 2024Exploratory Visual Analysis for Increasing Data Readiness in Artificial Intelligence Projects5 Sep 2024
- 2024Automating Code Adaptation for MLOps -- A Benchmarking Study on LLMs10 May 2024
- 2024Machine Learning Techniques for MRI Data Processing at Expanding Scale22 Apr 2024
- 2024Towards MLOps: A DevOps Tools Recommender System for Machine Learning System20 Feb 2024
12 newest of 37 All 37 (JSON)