mlsanityData to 7 Oct 2026

Who Needs MLOps: What Data Scientists Seek to Accomplish and How Can MLOps Help?

arXiv 2103.08942 ↗First posted 16 Mar 2021cs.SEcited by 37

Not on the map. Why?

Abstract (arXiv)

Following continuous software engineering practices, there has been an increasing interest in rapid deployment of machine learning (ML) features, called MLOps. In this paper, we study the importance of MLOps in the context of data scientists' daily activities, based on a survey where we collected responses from 331 professionals from 63 different countries in ML domain, indicating on what they were working on in the last three months. Based on the results, up to 40% respondents say that they work with both models and infrastructure; the majority of the work revolves around relational and time series data; and the largest categories of problems to be solved are predictive analysis, time series data, and computer vision. The biggest perceived problems revolve around data, although there is some awareness of problems related to deploying models to production and related procedures. To hypothesise, we believe that organisations represented in the survey can be divided to three categories -- (i) figuring out how to best use data; (ii) focusing on building the first models and getting them to production; and (iii) managing several models, their versions and training datasets, as well as retraining and frequent deployment of retrained models. In the results, the majority of respondents are in category (i) or (ii), focusing on data and models; however the benefits of MLOps only emerge in category (iii) when there is a need for frequent retraining and redeployment. Hence, setting up an MLOps pipeline is a natural step to take, when an organization takes the step from ML as a proof-of-concept to ML as a part of nominal activities.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Mar 2021.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 10; 2023: 11; 2024: 8; 2025: 3; 2026: 1.

37 papers.

Sort:

  1. 2021Trustworthy AI: From Principles to Practicescited by 206
  2. 2022Machine Learning Operations (MLOps): Overview, Definition, and Architecturecited by 126
  3. 2021Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Processcited by 56
  4. 2022Sensible AI: Re-imagining Interpretability and Explainability using Sensemaking Theorycited by 32
  5. 2022MLOps -- Definitions, Tools and Challengescited by 25
  6. 2022Operationalizing Machine Learning: An Interview Studycited by 25
  7. 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitionerscited by 22
  8. 2023MLOps: A Reviewcited by 16
  9. 2022DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systemscited by 14
  10. 2023The Pipeline for the Continuous Development of Artificial Intelligence Models -- Current State of Research and Practicecited by 14
  11. 2023Overcoming the Stability Gap in Continual Learningcited by 13
  12. 2022A Human-Centric Take on Model Monitoringcited by 9
25 more
  1. 2023Machine Learning with Requirements: a Manifestocited by 8
  2. 2022Putting AI Ethics into Practice: The Hourglass Model of Organizational AI Governancecited by 6
  3. 2022Capabilities for Better ML Engineeringcited by 3
  4. 2024Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approachcited by 3
  5. 2025Towards Secure MLOps: Surveying Attacks, Mitigation Strategies, and Research Challengescited by 3
  6. 2021Disease Progression Modeling Workbench 360cited by 2
  7. 2022A Preliminary Investigation of MLOps Practices in GitHubcited by 2
  8. 2023Scalable End-to-End ML Platforms: from AutoML to Self-servecited by 2
  9. 2023MLHOps: Machine Learning for Healthcare Operationscited by 2
  10. 2023MLOps: A Step Forward to Enterprise Machine Learningcited by 2
  11. 2023Measuring Distributional Shifts in Text: The Advantage of Language Model-Based Embeddingscited by 2
  12. 2024Towards MLOps: A DevOps Tools Recommender System for Machine Learning Systemcited by 2
  13. 2022Designing an Efficient End-to-end Machine Learning Pipeline for Real-time Empty-shelf Detectioncited by 1
  14. 2023AI for Agile development: a Meta-Analysiscited by 1
  15. 2024Exploratory Visual Analysis for Increasing Data Readiness in Artificial Intelligence Projectscited by 1
  16. 2024OML-AD: Online Machine Learning for Anomaly Detection in Time Series Datacited by 1
  17. 2024Machine Learning Operations: A Mapping Studycited by 1
  18. 2021Opportunities for Machine Learning to Accelerate Halide Perovskite Commercialization and Scale-Upcited by 0
  19. 2023MLOps with enhanced performance control and observabilitycited by 0
  20. 2024Machine Learning Techniques for MRI Data Processing at Expanding Scalecited by 0
  21. 2024Automating Code Adaptation for MLOps -- A Benchmarking Study on LLMscited by 0
  22. 2025Addressing Quality Challenges in Deep Learning: The Role of MLOps and Domain Knowledgecited by 0
  23. 2024GenAIOps for GenAI Model-Agilitycited by 0
  24. 2025Proposing a Framework for Machine Learning Adoption on Legacy Systemscited by 0
  25. 2026Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logisticscited by 0