Explaining AI Decisions: Towards Achieving Human-Centered Explainability in Smart Home Environments
Not on the map. Why?
Abstract (arXiv)
Smart home systems are gaining popularity as homeowners strive to enhance their living and working environments while minimizing energy consumption. However, the adoption of artificial intelligence (AI)-enabled decision-making models in smart home systems faces challenges due to the complexity and black-box nature of these systems, leading to concerns about explainability, trust, transparency, accountability, and fairness. The emerging field of explainable artificial intelligence (XAI) addresses these issues by providing explanations for the models' decisions and actions. While state-of-the-art XAI methods are beneficial for AI developers and practitioners, they may not be easily understood by general users, particularly household members. This paper advocates for human-centered XAI methods, emphasizing the importance of delivering readily comprehensible explanations to enhance user satisfaction and drive the adoption of smart home systems. We review state-of-the-art XAI methods and prior studies focusing on human-centered explanations for general users in the context of smart home applications. Through experiments on two smart home application scenarios, we demonstrate that explanations generated by prominent XAI techniques might not be effective in helping users understand and make decisions. We thus argue for the necessity of a human-centric approach in representing explanations in smart home systems and highlight relevant human-computer interaction (HCI) methodologies, including user studies, prototyping, technology probes analysis, and heuristic evaluation, that can be employed to generate and present human-centered explanations to users.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 74 references that are in the map. First posted on arXiv 23 Apr 2024.
Builds on
20 of 74 references.
References · 20
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 612
- 2020Captum: A unified and generic model interpretability library for PyTorchcited by 542
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
- 2018Manipulating and Measuring Model Interpretabilitycited by 256
- 2019Interpretable Counterfactual Explanations Guided by Prototypescited by 223
- 2020Evaluating Explainable AI: Which Algorithmic Explanations Help Users Predict Model Behavior?cited by 189
8 more
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2022Explainable AI for Bioinformatics: Methods, Tools, and Applicationscited by 11
- 2020Balancing thermal comfort datasets: We GAN, but should we?cited by 7
- 2020Transfer Learning for Thermal Comfort Prediction in Multiple Citiescited by 6
- 2021Personal thermal comfort models using digital twins: Preference prediction with BIM-extracted spatial-temporal proximity data from Build2Veccited by 4
- 2021Explainable Artificial Intelligence for Smart City Application: A Secure and Trusted Platformcited by 4
- 2022Interpreting Black-box Machine Learning Models for High Dimensional Datasetscited by 4
- 2023Unveiling Black-boxes: Explainable Deep Learning Models for Patent Classificationcited by 2
Built on by
Not cited yet.