Towards an MLOps Architecture for XAI in Industrial Applications
Not on the map. Why?
Abstract (arXiv)
Machine learning (ML) has become a popular tool in the industrial sector as it helps to improve operations, increase efficiency, and reduce costs. However, deploying and managing ML models in production environments can be complex. This is where Machine Learning Operations (MLOps) comes in. MLOps aims to streamline this deployment and management process. One of the remaining MLOps challenges is the need for explanations. These explanations are essential for understanding how ML models reason, which is key to trust and acceptance. Better identification of errors and improved model accuracy are only two resulting advantages. An often neglected fact is that deployed models are bypassed in practice when accuracy and especially explainability do not meet user expectations. We developed a novel MLOps software architecture to address the challenge of integrating explanations and feedback capabilities into the ML development and deployment processes. In the project EXPLAIN, our architecture is implemented in a series of industrial use cases. The proposed MLOps software architecture has several advantages. It provides an efficient way to manage ML models in production environments. Further, it allows for integrating explanations into the development and deployment processes.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 12 of its 74 references that are in the map. First posted on arXiv 22 Sep 2023.
Builds on
12 of 74 references.
References · 12
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,089
- 2020Making deep neural networks right for the right scientific reasons by interacting with their explanationscited by 142
- 2018Explaining Explanations in AIcited by 137
- 2022MLOps -- Definitions, Tools and Challengescited by 25
- 2015Concept Drift Detection for Streaming Datacited by 18
- 2020timeXplain -- A Framework for Explaining the Predictions of Time Series Classifierscited by 9
- 2017Concept Drift Detection and Adaptation with Hierarchical Hypothesis Testingcited by 6
- 2019Explainable Failure Predictions with RNN Classifiers based on Time Series Datacited by 3
- 2021Test Automation with Grad-CAM Heatmaps -- A Future Pipe Segment in MLOps for Vision AI?cited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.