A Transparency Paradox? Investigating the Impact of Explanation Specificity and Autonomous Vehicle Perceptual Inaccuracies on Passengers
Not on the map. Why?
Abstract (arXiv)
Transparency in automated systems could be afforded through the provision of intelligible explanations. While transparency is desirable, might it lead to catastrophic outcomes (such as anxiety), that could outweigh its benefits? It's quite unclear how the specificity of explanations (level of transparency) influences recipients, especially in autonomous driving (AD). In this work, we examined the effects of transparency mediated through varying levels of explanation specificity in AD. We first extended a data-driven explainer model by adding a rule-based option for explanation generation in AD, and then conducted a within-subject lab study with 39 participants in an immersive driving simulator to study the effect of the resulting explanations. Specifically, our investigation focused on: (1) how different types of explanations (specific vs. abstract) affect passengers' perceived safety, anxiety, and willingness to take control of the vehicle when the vehicle perception system makes erroneous predictions; and (2) the relationship between passengers' behavioural cues and their feelings during the autonomous drives. Our findings showed that passengers felt safer with specific explanations when the vehicle's perception system had minimal errors, while abstract explanations that hid perception errors led to lower feelings of safety. Anxiety levels increased when specific explanations revealed perception system errors (high transparency). We found no significant link between passengers' visual patterns and their anxiety levels. Our study suggests that passengers prefer clear and specific explanations (high transparency) when they originate from autonomous vehicles (AVs) with optimal perceptual accuracy.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 68 references that are in the map. First posted on arXiv 16 Aug 2024.
Builds on
12 of 68 references.
References · 12
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2018Manipulating and Measuring Model Interpretabilitycited by 256
- 2018Explaining Explanations in AIcited by 136
- 2021Explanations in Autonomous Driving: A Surveycited by 80
- 2020The Emerging Landscape of Explainable AI Planning and Decision Makingcited by 44
- 2022DReyeVR: Democratizing Virtual Reality Driving Simulation for Behavioural & Interaction Researchcited by 8
- 2022From Spoken Thoughts to Automated Driving Commentary: Predicting and Explaining Intelligent Vehicles' Actionscited by 8
- 2021Importance of Instruction for Pedestrian-Automated Driving Vehicle Interaction with an External Human Machine Interface: Effects on Pedestrians' Situation Awareness, Trust, Perceived Risks and Decision Makingcited by 3
Built on by
Not cited yet.