# What Did My Car Say? Impact of Autonomous Vehicle Explanation Errors and Driving Context On Comfort, Reliance, Satisfaction, and Driving Confidence

arXiv: https://arxiv.org/abs/2409.05731 · HTML: https://mlsanity.com/paper/2409.05731/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 21 of its 81 references that are in the map.
- First posted on arXiv 9 Sep 2024.

## Builds on (most cited first, 21 of 21)

- ["Why Should I Trust You?": Explaining the Predictions of Any Classifier](https://mlsanity.com/paper/1602.04938/) (2016)
- [CARLA: An Open Urban Driving Simulator](https://mlsanity.com/paper/1711.03938/) (2017)
- [Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps](https://mlsanity.com/paper/1312.6034/) (2013)
- [Explanation in Artificial Intelligence: Insights from the Social Sciences](https://mlsanity.com/paper/1706.07269/) (2017)
- [CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning](https://mlsanity.com/paper/1711.05225/) (2017)
- [Hallucination is Inevitable: An Innate Limitation of Large Language Models](https://mlsanity.com/paper/2401.11817/) (2024)
- [Metrics for Explainable AI: Challenges and Prospects](https://mlsanity.com/paper/1812.04608/) (2018)
- [Textual Explanations for Self-Driving Vehicles](https://mlsanity.com/paper/1807.11546/) (2018)
- [Human-Centered Explainable AI (XAI): From Algorithms to User Experiences](https://mlsanity.com/paper/2110.10790/) (2021)
- [Explanations Can Reduce Overreliance on AI Systems During Decision-Making](https://mlsanity.com/paper/2212.06823/) (2022)
- [Human-centered Explainable AI: Towards a Reflective Sociotechnical Approach](https://mlsanity.com/paper/2002.01092/) (2020)
- [Explainable AI is Dead, Long Live Explainable AI! Hypothesis-driven decision support](https://mlsanity.com/paper/2302.12389/) (2023)
- [The Role of Domain Expertise in User Trust and the Impact of First Impressions with Intelligent Systems](https://mlsanity.com/paper/2008.09100/) (2020)
- [Waymo Public Road Safety Performance Data](https://mlsanity.com/paper/2011.00038/) (2020)
- [DReyeVR: Democratizing Virtual Reality Driving Simulation for Behavioural & Interaction Research](https://mlsanity.com/paper/2201.01931/) (2022)
- [Modeling Dispositional and Initial learned Trust in Automated Vehicles with Predictability and Explainability](https://mlsanity.com/paper/2012.13603/) (2020)
- [Explainable AI And Visual Reasoning: Insights From Radiology](https://mlsanity.com/paper/2304.03318/) (2023)
- [An Investigation of Drivers' Dynamic Situational Trust in Conditionally Automated Driving](https://mlsanity.com/paper/2112.04095/) (2021)
- [Effects of Multimodal Explanations for Autonomous Driving on Driving Performance, Cognitive Load, Expertise, Confidence, and Trust](https://mlsanity.com/paper/2401.04206/) (2024)
- [Investigating Explanations in Conditional and Highly Automated Driving: The Effects of Situation Awareness and Modality](https://mlsanity.com/paper/2207.07496/) (2022)
- [Developing Situational Awareness for Joint Action with Autonomous Vehicles](https://mlsanity.com/paper/2404.11800/) (2024)

## Built on by (most cited first, 3 of 3)

- [Predicting Trust In Autonomous Vehicles: Modeling Young Adult Psychosocial Traits, Risk-Benefit Attitudes, And Driving Factors With Machine Learning](https://mlsanity.com/paper/2409.08980/) (2024)
- [Context-aware, Ante-hoc Explanations of Driving Behaviour](https://mlsanity.com/paper/2511.14428/) (2025)
- [When2Talk: When Should a Proactive In-Car Agent Talk?](https://mlsanity.com/paper/2609.12503/) (2026)

## Abstract (arXiv)

Explanations for autonomous vehicle (AV) decisions may build trust, however, explanations can contain errors. In a simulated driving study (n = 232), we tested how AV explanation errors, driving context characteristics (perceived harm and driving difficulty), and personal traits (prior trust and expertise) affected a passenger's comfort in relying on an AV, preference for control, confidence in the AV's ability, and explanation satisfaction. Errors negatively affected all outcomes. Surprisingly, despite identical driving, explanation errors reduced ratings of the AV's driving ability. Severity and potential harm amplified the negative impact of errors. Contextual harm and driving difficulty directly impacted outcome ratings and influenced the relationship between errors and outcomes. Prior trust and expertise were positively associated with outcome ratings. Results emphasize the need for accurate, contextually adaptive, and personalized AV explanations to foster trust, reliance, satisfaction, and confidence. We conclude with design, research, and deployment recommendations for trustworthy AV explanation systems.
