mlsanityData to 7 Oct 2026

XAIR: A Framework of Explainable AI in Augmented Reality

arXiv 2303.16292 ↗First posted 28 Mar 2023cs.HC cs.AI cs.LGcited by 17

Not on the map. Why?

Abstract (arXiv)

Explainable AI (XAI) has established itself as an important component of AI-driven interactive systems. With Augmented Reality (AR) becoming more integrated in daily lives, the role of XAI also becomes essential in AR because end-users will frequently interact with intelligent services. However, it is unclear how to design effective XAI experiences for AR. We propose XAIR, a design framework that addresses "when", "what", and "how" to provide explanations of AI output in AR. The framework was based on a multi-disciplinary literature review of XAI and HCI research, a large-scale survey probing 500+ end-users' preferences for AR-based explanations, and three workshops with 12 experts collecting their insights about XAI design in AR. XAIR's utility and effectiveness was verified via a study with 10 designers and another study with 12 end-users. XAIR can provide guidelines for designers, inspiring them to identify new design opportunities and achieve effective XAI designs in AR.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 56 of its 257 references that are in the map. First posted on arXiv 28 Mar 2023.

Builds on

56 of 257 references.

References · 56

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  5. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  6. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  7. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  8. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  9. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  10. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  11. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  12. 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
38 more
  1. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  2. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  3. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
  4. 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
  5. 2020Rescaling Egocentric Visioncited by 529
  6. 2019End-to-End Learning of Visual Representations from Uncurated Instructional Videoscited by 506
  7. 2017Causal Effect Inference with Deep Latent-Variable Modelscited by 408
  8. 2018Deep Learning for Generic Object Detection: A Surveycited by 392
  9. 2017Adversarial Examples: Attacks and Defenses for Deep Learningcited by 350
  10. 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
  11. 2018Metrics for Explainable AI: Challenges and Prospectscited by 257
  12. 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
  13. 2018Explainable Recommendation: A Survey and New Perspectivescited by 210
  14. 2019Explainable Machine Learning in Deploymentcited by 210
  15. 2017Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Modelscited by 202
  16. 2018Local Rule-Based Explanations of Black Box Decision Systemscited by 165
  17. 2019One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniquescited by 164
  18. 2015Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction modelcited by 140
  19. 2018Explaining Explanations in AIcited by 136
  20. 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
  21. 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
  22. 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
  23. 2019Human-Centered Tools for Coping with Imperfect Algorithms during Medical Decision-Makingcited by 109
  24. 2019Towards Explainable Artificial Intelligencecited by 106
  25. 2018'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisionscited by 91
  26. 2014Automated Experiments on Ad Privacy Settings: A Tale of Opacity, Choice, and Discriminationcited by 83
  27. 2018Predicting Gaze in Egocentric Video by Learning Task-dependent Attention Transitioncited by 78
  28. 2015The Bayesian Case Model: A Generative Approach for Case-Based Reasoning and Prototype Classificationcited by 76
  29. 2019Personalized HeartSteps: A Reinforcement Learning Algorithm for Optimizing Physical Activitycited by 70
  30. 2019Towards a Rigorous Evaluation of XAI Methods on Time Seriescited by 67
  31. 2021All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agendacited by 67
  32. 2018Visualizing the Feature Importance for Black Box Modelscited by 55
  33. 2018Connecting Gaze, Scene, and Attention: Generalized Attention Estimation via Joint Modeling of Gaze and Scene Saliencycited by 53
  34. 2018Stakeholders in Explainable AIcited by 48
  35. 2021The Who in XAI: How AI Background Shapes Perceptions of AI Explanationscited by 48
  36. 2017Human-in-the-loop Artificial Intelligencecited by 40
  37. 2020CheXplain: Enabling Physicians to Explore and UnderstandData-Driven, AI-Enabled Medical Imaging Analysiscited by 40
  38. 2019Human-Centered Artificial Intelligence and Machine Learningcited by 37

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 6; 2025: 7; 2026: 3.

17 papers.

Sort:

By area:

  1. 2023LLMR: Real-time Prompting of Interactive Worlds using Large Language Modelscited by 39
  2. 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Surveycited by 15
  3. 2024Augmented Object Intelligence with XR-Objectscited by 12
  4. 2024G-VOILA: Gaze-Facilitated Information Querying in Daily Scenarioscited by 8
  5. 2026VisionClaw: Always-On AI Agents through Smart Glassescited by 4
  6. 2024PARSE-Ego4D: Personal Action Recommendation Suggestions for Egocentric Videoscited by 3
  7. 2024TOM: A Development Platform For Wearable Intelligent Assistantscited by 3
  8. 2025Less or More: Towards Glanceable Explanations for LLM Recommendations Using Ultra-Small Devicescited by 3
  9. 2026SpeechLess: Micro-utterance with Personalized Spatial Memory-aware Assistant in Everyday Augmented Realitycited by 3
  10. 2024Explainable Interface for Human-Autonomy Teaming: A Surveycited by 2
  11. 2025On the Design and Evaluation of Human-centered Explainable AI Systems: A Systematic Review and Taxonomycited by 2
  12. 2025Composable Building Blocks for Controllable and Transparent Interactive AI Systemscited by 1
5 more
  1. 2025PILAR: Personalizing Augmented Reality Interactions with LLM-based Human-Centric and Trustworthy Explanations for Daily Use Casescited by 1
  2. 2025AutoMR: A Universal Time Series Motion Recognition Pipelinecited by 0
  3. 2025MATCH: Engineering Transparent and Controllable Conversational XAI Systems through Composable Building Blockscited by 0
  4. 2025Words into World: A Task-Adaptive Agent for Language-Guided Spatial Retrieval in ARcited by 0
  5. 2026The Shadow Boss: Identifying Atomized Manipulations in Agentic Employment of XR Users using Scenario Constructionscited by 0