mlsanityData to 7 Oct 2026

Explainable Artificial Intelligence (XAI): An Engineering Perspective

arXiv 2101.03613 ↗First posted 10 Jan 2021cs.LG cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

The remarkable advancements in Deep Learning (DL) algorithms have fueled enthusiasm for using Artificial Intelligence (AI) technologies in almost every domain; however, the opaqueness of these algorithms put a question mark on their applications in safety-critical systems. In this regard, the `explainability' dimension is not only essential to both explain the inner workings of black-box algorithms, but it also adds accountability and transparency dimensions that are of prime importance for regulators, consumers, and service providers. eXplainable Artificial Intelligence (XAI) is the set of techniques and methods to convert the so-called black-box AI algorithms to white-box algorithms, where the results achieved by these algorithms and the variables, parameters, and steps taken by the algorithm to reach the obtained results, are transparent and explainable. To complement the existing literature on XAI, in this paper, we take an `engineering' approach to illustrate the concepts of XAI. We discuss the stakeholders in XAI and describe the mathematical contours of XAI from engineering perspective. Then we take the autonomous car as a use-case and discuss the applications of XAI for its different components such as object detection, perception, control, action decision, and so on. This work is an exploratory study to identify new avenues of research in the field of XAI.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 10 Jan 2021.

Builds on

21 of 42 references.

References · 21

  1. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  2. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  3. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  4. 2018Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Surveycited by 459
  5. 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
  6. 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 401
  7. 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 252
  8. 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
  9. 2019Understanding Adversarial Attacks on Deep Learning Based Medical Image Analysis Systemscited by 151
  10. 2020Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representationscited by 150
  11. 2017Interpretable Learning for Self-Driving Cars by Visualizing Causal Attentioncited by 106
  12. 2020Explainable Object-induced Action Decision for Autonomous Vehiclescited by 88
9 more
  1. 2017What Does Explainable AI Really Mean? A New Conceptualization of Perspectivescited by 72
  2. 2018Stakeholders in Explainable AIcited by 48
  3. 2018Interpretable to Whom? A Role-based Model for Analyzing Interpretable Machine Learning Systemscited by 47
  4. 2020What Do You See? Evaluation of Explainable Artificial Intelligence (XAI) Interpretability through Neural Backdoorscited by 32
  5. 2019A Grounded Interaction Protocol for Explainable Artificial Intelligencecited by 22
  6. 2020To Explain or Not to Explain: A Study on the Necessity of Explanations for Autonomous Vehiclescited by 21
  7. 2019Interpretable CNNs for Object Classificationcited by 16
  8. 2019Outlining the Design Space of Explainable Intelligent Systems for Medical Diagnosiscited by 8
  9. 2020Explainable Deep Reinforcement Learning for UAV Autonomous Navigationcited by 4

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 2; 2023: 0; 2024: 1; 2025: 1.

6 papers.