Lessons from Usable ML Deployments and Application to Wind Turbine Monitoring
Not on the map. Why?
Abstract (arXiv)
Through past experiences deploying what we call usable ML (one step beyond explainable ML, including both explanations and other augmenting information) to real-world domains, we have learned three key lessons. First, many organizations are beginning to hire people who we call ``bridges'' because they bridge the gap between ML developers and domain experts, and these people fill a valuable role in developing usable ML applications. Second, a configurable system that enables easily iterating on usable ML interfaces during collaborations with bridges is key. Finally, there is a need for continuous, in-deployment evaluations to quantify the real-world impact of usable ML. Throughout this paper, we apply these lessons to the task of wind turbine monitoring, an essential task in the renewable energy domain. Turbine engineers and data analysts must decide whether to perform costly in-person investigations on turbines to prevent potential cases of brakepad failure, and well-tuned usable ML interfaces can aid with this decision-making process. Through the applications of our lessons to this task, we hope to demonstrate the potential real-world impact of usable ML in the renewable energy domain.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 24 references that are in the map. First posted on arXiv 5 Dec 2023.
Builds on
13 of 24 references.
References · 13
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2019Explainable Machine Learning in Deploymentcited by 210
- 2020Evaluating Explainable AI: Which Algorithmic Explanations Help Users Predict Model Behavior?cited by 189
- 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
- 2021What I Cannot Predict, I Do Not Understand: A Human-Centered Evaluation Framework for Explainability Methodscited by 98
- 2020The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategiescited by 91
- 2020Human Factors in Model Interpretability: Industry Practices, Challenges, and Needscited by 73
- 2018Stakeholders in Explainable AIcited by 48
- 2021Sibyl: Understanding and Addressing the Usability Challenges of Machine Learning In High-Stakes Decision Makingcited by 19
Built on by
Not cited yet.