mlsanityData to 14 Oct 2026

Using AntiPatterns to avoid MLOps Mistakes

arXiv 2107.00079 ↗First posted 30 Jun 2021cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

We describe lessons learned from developing and deploying machine learning models at scale across the enterprise in a range of financial analytics applications. These lessons are presented in the form of antipatterns. Just as design patterns codify best software engineering practices, antipatterns provide a vocabulary to describe defective practices and methodologies. Here we catalog and document numerous antipatterns in financial ML operations (MLOps). Some antipatterns are due to technical errors, while others are due to not having sufficient knowledge of the surrounding context in which ML results are used. By providing a common vocabulary to discuss these situations, our intent is that antipatterns will support better documentation of issues, rapid communication between stakeholders, and faster resolution of problems. In addition to cataloging antipatterns, we describe solutions, best practices, and future directions toward MLOps maturity.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 20 of its 48 references that are in the map. First posted on arXiv 30 Jun 2021.

Builds on

20 of 48 references.

References · 20

  1. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  2. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  4. 2018Model Cards for Model Reportingcited by 1,080
  5. 2017Deep Reinforcement Learning that Matterscited by 754
  6. 2020Learning under Concept Drift: A Reviewcited by 477
  7. 2020Challenges in Deploying Machine Learning: a Survey of Case Studiescited by 152
  8. 2020Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertaintycited by 129
  9. 2018Troubling Trends in Machine Learning Scholarshipcited by 108
  10. 2017On the State of the Art of Evaluation in Neural Language Modelscited by 104
  11. 2018Tunability: Importance of Hyperparameters of Machine Learning Algorithmscited by 99
  12. 2015Characterizing Concept Driftcited by 94
8 more
  1. 2017Hyperparameter Importance Across Datasetscited by 63
  2. 2018Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanismscited by 53
  3. 2018Are All Languages Equally Hard to Language-Model?cited by 53
  4. 2019Bayesian Optimization for Iterative Learningcited by 19
  5. 2019HARK Side of Deep Learning -- From Grad Student Descent to Automated Machine Learningcited by 13
  6. 2018On the Importance of Strong Baselines in Bayesian Deep Learningcited by 12
  7. 2014'Beating the news' with EMBERS: Forecasting Civil Unrest using Open Source Indicatorscited by 10
  8. 2016Hierarchical Quickest Change Detection via Surrogatescited by 1

Built on by

Cited by year

Citing papers per year: 2022: 4; 2023: 0; 2024: 0; 2025: 1.

5 papers.