mlsanityData to 7 Oct 2026

Lessons from Usable ML Deployments and Application to Wind Turbine Monitoring

arXiv 2312.02859 ↗First posted 5 Dec 2023cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Through past experiences deploying what we call usable ML (one step beyond explainable ML, including both explanations and other augmenting information) to real-world domains, we have learned three key lessons. First, many organizations are beginning to hire people who we call ``bridges'' because they bridge the gap between ML developers and domain experts, and these people fill a valuable role in developing usable ML applications. Second, a configurable system that enables easily iterating on usable ML interfaces during collaborations with bridges is key. Finally, there is a need for continuous, in-deployment evaluations to quantify the real-world impact of usable ML. Throughout this paper, we apply these lessons to the task of wind turbine monitoring, an essential task in the renewable energy domain. Turbine engineers and data analysts must decide whether to perform costly in-person investigations on turbines to prevent potential cases of brakepad failure, and well-tuned usable ML interfaces can aid with this decision-making process. Through the applications of our lessons to this task, we hope to demonstrate the potential real-world impact of usable ML in the renewable energy domain.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 24 references that are in the map. First posted on arXiv 5 Dec 2023.

Builds on

13 of 24 references.

References · 13

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  2. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  3. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  4. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  5. 2019Explainable Machine Learning in Deploymentcited by 210
  6. 2020Evaluating Explainable AI: Which Algorithmic Explanations Help Users Predict Model Behavior?cited by 189
  7. 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
  8. 2021What I Cannot Predict, I Do Not Understand: A Human-Centered Evaluation Framework for Explainability Methodscited by 98
  9. 2020The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategiescited by 91
  10. 2020Human Factors in Model Interpretability: Industry Practices, Challenges, and Needscited by 73
  11. 2018Stakeholders in Explainable AIcited by 48
  12. 2021Sibyl: Understanding and Addressing the Usability Challenges of Machine Learning In High-Stakes Decision Makingcited by 19
1 more
  1. 2021On Two XAI Cultures: A Case Study of Non-technical Explanations in Deployed AI Systemcited by 5

Built on by

Not cited yet.