Explainable Artificial Intelligence (XAI): An Engineering Perspective
Not on the map. Why?
Abstract (arXiv)
The remarkable advancements in Deep Learning (DL) algorithms have fueled enthusiasm for using Artificial Intelligence (AI) technologies in almost every domain; however, the opaqueness of these algorithms put a question mark on their applications in safety-critical systems. In this regard, the `explainability' dimension is not only essential to both explain the inner workings of black-box algorithms, but it also adds accountability and transparency dimensions that are of prime importance for regulators, consumers, and service providers. eXplainable Artificial Intelligence (XAI) is the set of techniques and methods to convert the so-called black-box AI algorithms to white-box algorithms, where the results achieved by these algorithms and the variables, parameters, and steps taken by the algorithm to reach the obtained results, are transparent and explainable. To complement the existing literature on XAI, in this paper, we take an `engineering' approach to illustrate the concepts of XAI. We discuss the stakeholders in XAI and describe the mathematical contours of XAI from engineering perspective. Then we take the autonomous car as a use-case and discuss the applications of XAI for its different components such as object detection, perception, control, action decision, and so on. This work is an exploratory study to identify new avenues of research in the field of XAI.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 10 Jan 2021.
Builds on
21 of 42 references.
References · 21
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
- 2018Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Surveycited by 459
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
- 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 401
- 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 252
- 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
- 2019Understanding Adversarial Attacks on Deep Learning Based Medical Image Analysis Systemscited by 151
- 2020Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representationscited by 150
- 2017Interpretable Learning for Self-Driving Cars by Visualizing Causal Attentioncited by 106
- 2020Explainable Object-induced Action Decision for Autonomous Vehiclescited by 88
9 more
- 2017What Does Explainable AI Really Mean? A New Conceptualization of Perspectivescited by 72
- 2018Stakeholders in Explainable AIcited by 48
- 2018Interpretable to Whom? A Role-based Model for Analyzing Interpretable Machine Learning Systemscited by 47
- 2020What Do You See? Evaluation of Explainable Artificial Intelligence (XAI) Interpretability through Neural Backdoorscited by 32
- 2019A Grounded Interaction Protocol for Explainable Artificial Intelligencecited by 22
- 2020To Explain or Not to Explain: A Study on the Necessity of Explanations for Autonomous Vehiclescited by 21
- 2019Interpretable CNNs for Object Classificationcited by 16
- 2019Outlining the Design Space of Explainable Intelligent Systems for Medical Diagnosiscited by 8
- 2020Explainable Deep Reinforcement Learning for UAV Autonomous Navigationcited by 4
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 0; 2024: 1; 2025: 1.
6 papers.
- 2024A Review of Multimodal Explainable Artificial Intelligence: Past, Present and Futurecited by 9
- 2021Trustworthy AI and Robotics and the Implications for the AEC Industry: A Systematic Literature Review and Future Potentialscited by 4
- 2021Explainable Artificial Intelligence for Smart City Application: A Secure and Trusted Platformcited by 4
- 2022Explainable Artificial Intelligence: Precepts, Methods, and Opportunities for Research in Constructioncited by 4
- 2022Explain yourself! Effects of Explanations in Human-Robot Interactioncited by 2
- 2025Adaptive GR(1) Specification Repair for Liveness-Preserving Shielding in Reinforcement Learningcited by 0
- 2025Adaptive GR(1) Specification Repair for Liveness-Preserving Shielding in Reinforcement Learning4 Nov 2025
- 2024A Review of Multimodal Explainable Artificial Intelligence: Past, Present and Future18 Dec 2024
- 2022Explainable Artificial Intelligence: Precepts, Methods, and Opportunities for Research in Construction12 Nov 2022
- 2022Explain yourself! Effects of Explanations in Human-Robot Interaction9 Apr 2022
- 2021Explainable Artificial Intelligence for Smart City Application: A Secure and Trusted Platform31 Oct 2021
- 2021Trustworthy AI and Robotics and the Implications for the AEC Industry: A Systematic Literature Review and Future Potentials27 Sep 2021