mlsanityData to 7 Oct 2026

Explanations in Autonomous Driving: A Survey

arXiv 2103.05154 ↗First posted 9 Mar 2021cs.HC cs.AI cs.CYcited by 80

Not on the map. Why?

Cited by 26 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The automotive industry has witnessed an increasing level of development in the past decades; from manufacturing manually operated vehicles to manufacturing vehicles with a high level of automation. With the recent developments in Artificial Intelligence (AI), automotive companies now employ blackbox AI models to enable vehicles to perceive their environments and make driving decisions with little or no input from a human. With the hope to deploy autonomous vehicles (AV) on a commercial scale, the acceptance of AV by society becomes paramount and may largely depend on their degree of transparency, trustworthiness, and compliance with regulations. The assessment of the compliance of AVs to these acceptance requirements can be facilitated through the provision of explanations for AVs' behaviour. Explainability is therefore seen as an important requirement for AVs. AVs should be able to explain what they have 'seen', done, and might do in environments in which they operate. In this paper, we provide a comprehensive survey of the existing body of work around explainable autonomous driving. First, we open with a motivation for explanations by highlighting and emphasising the importance of transparency, accountability, and trust in AVs; and examining existing regulations and standards related to AVs. Second, we identify and categorise the different stakeholders involved in the development, use, and regulation of AVs and elicit their explanation requirements for AV. Third, we provide a rigorous review of previous work on explanations for the different AV operations (i.e., perception, localisation, planning, control, and system management). Finally, we identify pertinent challenges and provide recommendations, such as a conceptual framework for AV explainability. This survey aims to provide the fundamental knowledge required of researchers who are interested in explainability in AVs.

Key facts. Cited by 80 papers in the map (data through 7 Oct 2026). Builds on 51 of its 231 references that are in the map. First posted on arXiv 9 Mar 2021.

Builds on

51 of 231 references.

References · 51

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  4. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  5. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  6. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  7. 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
  8. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  9. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
  10. 2016End to End Learning for Self-Driving Carscited by 1,000
  11. 2014Striving for Simplicity: The All Convolutional Netcited by 983
  12. 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
38 more
  1. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
  2. 2019Attention is not Explanationcited by 916
  3. 2019Attention is not not Explanationcited by 629
  4. 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 590
  5. 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
  6. 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
  7. 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 359
  8. 2018Metrics for Explainable AI: Challenges and Prospectscited by 257
  9. 2018Manipulating and Measuring Model Interpretabilitycited by 256
  10. 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 252
  11. 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
  12. 2018Textual Explanations for Self-Driving Vehiclescited by 226
  13. 2017Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Modelscited by 202
  14. 2017Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Artcited by 182
  15. 2019Smooth Grad-CAM++: An Enhanced Inference Level Visualization Technique for Deep Convolutional Neural Network Modelscited by 118
  16. 2017Interpretable Learning for Self-Driving Cars by Visualizing Causal Attentioncited by 106
  17. 2018Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoningcited by 102
  18. 2018'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisionscited by 91
  19. 2020Explainable Object-induced Action Decision for Autonomous Vehiclescited by 88
  20. 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
  21. 2018Autonomous Vehicles that Interact with Pedestrians: A Survey of Theory and Practicecited by 74
  22. 2020The Emerging Landscape of Explainable AI Planning and Decision Makingcited by 44
  23. 2019Global Aggregations of Local Explanations for Black Box modelscited by 30
  24. 2020When, Where, and What? A New Dataset for Anomaly Detection in Driving Videoscited by 27
  25. 2015Plan Explicability and Predictability for Robot Task Planningcited by 26
  26. 2020Explaining Autonomous Driving by Learning End-to-End Visual Attentioncited by 25
  27. 2017Agreeing to Cross: How Drivers and Pedestrians Communicatecited by 23
  28. 2020To Explain or Not to Explain: A Study on the Necessity of Explanations for Autonomous Vehiclescited by 21
  29. 2019Localization Requirements for Autonomous Vehiclescited by 16
  30. 2020Driving Behavior Explanation with Multi-level Fusioncited by 12
  31. 2016Interpreting the Predictions of Complex ML Models by Layer-wise Relevance Propagationcited by 11
  32. 2018Towards Providing Explanations for AI Planner Decisionscited by 9
  33. 2020Sense-Assess-eXplain (SAX): Building Trust in Autonomous Vehicles in Challenging Real-World Driving Scenarioscited by 9
  34. 2019X-ToM: Explaining with Theory-of-Mind for Gaining Justified Human Trustcited by 8
  35. 2017Towards Moral Autonomous Systemscited by 7
  36. 2018Blockchain-inspired Event Recording System for Autonomous Vehiclescited by 5
  37. 2019Interpretable Self-Attention Temporal Reasoning for Driving Behavior Understandingcited by 5
  38. 2019The Smart Black Box: A Value-Driven High-Bandwidth Automotive Event Data Recordercited by 3

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 9; 2023: 20; 2024: 26; 2025: 10; 2026: 14.

80 papers.

Sort:

By area:

  1. 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Drivingcited by 231
  2. 2024RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Learning in Multi-Modal Large Language Modelcited by 91
  3. 2023Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveyscited by 75
  4. 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
  5. 2022"Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interactioncited by 63
  6. 2023Drive Anywhere: Generalizable End-to-end Autonomous Driving with Multi-modal Foundation Modelscited by 59
  7. 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52
  8. 2022ProtoVAE: A Trustworthy Self-Explainable Prototypical Variational Modelcited by 34
  9. 2022SAFARI: Versatile and Efficient Evaluations for Robustness of Interpretabilitycited by 28
  10. 2023Milestones in Autonomous Driving and Intelligent Vehicles Part I: Control, Computing System Design, Communication, HD Map, Testing, and Human Behaviorscited by 25
  11. 2022Prompt-based Learning for Unpaired Image Captioningcited by 23
  12. 2024Probing Multimodal LLMs as World Models for Drivingcited by 19
38 more
  1. 2024Research on Autonomous Driving Decision-making Strategies based Deep Reinforcement Learningcited by 17
  2. 2023Explaining Autonomous Driving Actions with Visual Question Answeringcited by 16
  3. 2024SimpleLLM4AD: An End-to-End Vision-Language Model with Graph Visual Question Answering for Autonomous Drivingcited by 16
  4. 2022Fairness and Bias in Robot Learningcited by 10
  5. 2022Why Should I Choose You? AutoXAI: A Framework for Selecting and Tuning eXplainable AI Solutionscited by 10
  6. 2023Interactive Autonomous Navigation with Internal State Inference and Interactivity Estimationcited by 10
  7. 2023Explainable Action Prediction through Self-Supervision on Scene Graphscited by 9
  8. 2024Safety Implications of Explainable Artificial Intelligence in End-to-End Autonomous Drivingcited by 7
  9. 2023Textual Explanations for Automated Commentary Drivingcited by 6
  10. 2023Human Attention-Guided Explainable Artificial Intelligence for Computer Vision Modelscited by 6
  11. 2023Prototypical Self-Explainable Models Without Re-trainingcited by 6
  12. 2024Advancing Explainable Autonomous Vehicle Systems: A Comprehensive Review and Research Roadmapcited by 6
  13. 2024Exploring Latent Pathways: Enhancing the Interpretability of Autonomous Driving with a Variational Autoencodercited by 6
  14. 2025Logic-RAG: Augmenting Large Multimodal Models with Visual-Spatial Knowledge for Road Scene Understandingcited by 6
  15. 2023Empowering CAM-Based Methods with Capability to Generate Fine-Grained and High-Faithfulness Explanationscited by 5
  16. 2024DRIVE: Dependable Robust Interpretable Visionary Ensemble Framework in Autonomous Drivingcited by 5
  17. 2024Hierarchical End-to-End Autonomous Driving: Integrating BEV Perception with Deep Reinforcement Learningcited by 5
  18. 2025CAMs as Shapley Value-based Explainerscited by 5
  19. 2022Human-AI Shared Control via Policy Dissectioncited by 4
  20. 2023Addressing Limitations of State-Aware Imitation Learning for Autonomous Drivingcited by 3
  21. 2024Effects of Multimodal Explanations for Autonomous Driving on Driving Performance, Cognitive Load, Expertise, Confidence, and Trustcited by 3
  22. 2024Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairnesscited by 3
  23. 2024Flex: End-to-End Text-Instructed Visual Navigation from Foundation Model Featurescited by 3
  24. 2025Towards Balancing Preference and Performance through Adaptive Personalized Explainabilitycited by 3
  25. 2026See Less, Drive Better: Generalizable End-to-End Autonomous Driving via Foundation Models Stochastic Patch Selectioncited by 3
  26. 2026C-CoT: Counterfactual Chain-of-Thought with Vision-Language Models for Safe Autonomous Drivingcited by 3
  27. 2022A method for ethical AI in Defence: A case study on developing trustworthy autonomous systemscited by 2
  28. 2023Effects of Explanation Specificity on Passengers in Autonomous Drivingcited by 2
  29. 2023DeepIPCv2: LiDAR-powered Robust Environmental Perception and Navigational Control for Autonomous Vehiclecited by 2
  30. 2023Acquiring Qualitative Explainable Graphs for Automated Driving Scene Interpretationcited by 2
  31. 2024Explainable Interface for Human-Autonomy Teaming: A Surveycited by 2
  32. 2024Generally-Occurring Model Change for Robust Counterfactual Explanationscited by 2
  33. 2024METDrive: Multi-modal End-to-end Autonomous Driving with Temporal Guidancecited by 2
  34. 2024Scene-Aware Explainable Multimodal Trajectory Predictioncited by 2
  35. 2024GIFT: A Framework Towards Global Interpretable Faithful Textual Explanations of Vision Classifierscited by 2
  36. 2025A Novel Multi-layer Task-centric and Data Quality Framework for Autonomous Drivingcited by 2
  37. 2026SafeAlign-VLA: A Negative-Enhanced Safe Alignment Framework for Risk-Aware Autonomous Drivingcited by 2
  38. 2023Adaptive Road Configurations for Improved Autonomous Vehicle-Pedestrian Interactions using Reinforcement Learningcited by 1

50 most cited of 80 All 80 (JSON)