A systematic review and taxonomy of explanations in decision support and recommender systems
Not on the map. Why?
Abstract (arXiv)
With the recent advances in the field of artificial intelligence, an increasing number of decision-making tasks are delegated to software systems. A key requirement for the success and adoption of such systems is that users must trust system choices or even fully automated decisions. To achieve this, explanation facilities have been widely investigated as a means of establishing trust in these systems since the early years of expert systems. With today's increasingly sophisticated machine learning algorithms, new challenges in the context of explanations, accountability, and trust towards such systems constantly arise. In this work, we systematically review the literature on explanations in advice-giving systems. This is a family of systems that includes recommender systems, which is one of the most successful classes of advice-giving software in practice. We investigate the purposes of explanations as well as how they are generated, presented to users, and evaluated. As a result, we derive a novel comprehensive taxonomy of aspects to be considered when designing explanation facilities for current and future decision support systems. The taxonomy includes a variety of different facets, such as explanation objective, responsiveness, content and presentation. Moreover, we identified several challenges that remain unaddressed so far, for example related to fine-grained issues associated with the presentation of explanations and how explanation facilities are evaluated.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 9; 2023: 13; 2024: 4; 2025: 6; 2026: 3.
45 papers.
Sort:
By area:
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 90
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2021Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needscited by 64
- 2022Fairness in Recommender Systems: Research Landscape and Future Directionscited by 30
- 2022What Makes a Good Explanation?: A Harmonized View of Properties of Explanationscited by 21
- 2022Explainability in Music Recommender Systemscited by 15
- 2021Intuitively Assessing ML Model Reliability through Example-Based Explanations and Editing Model Inputscited by 9
- 2022An Explainable Decision Support System for Predictive Process Analyticscited by 8
- 2023Is More Always Better? The Effects of Personal Characteristics and Level of Detail on the Perception of Explanations in a Recommender Systemcited by 8
33 more
- 2024Unpacking Human-AI interactions: From interaction primitives to a design spacecited by 7
- 2021Yes We Care! -- Certification for Machine Learning Methods through the Care Label Frameworkcited by 5
- 2022Explainability in Process Outcome Prediction: Guidelines to Obtain Interpretable and Faithful Modelscited by 5
- 2023Co-audit: tools to help humans double-check AI-generated contentcited by 5
- 2024How Human-Centered Explainable AI Interface Are Designed and Evaluated: A Systematic Surveycited by 5
- 2023Invisible Users: Uncovering End-Users' Requirements for Explainable AI via Explanation Forms and Goalscited by 4
- 2023Justification vs. Transparency: Why and How Visual Explanations in a Scientific Literature Recommender Systemcited by 4
- 2023Two-Stage Holistic and Contrastive Explanation of Image Classificationcited by 4
- 2023Trust and Transparency in Recommender Systemscited by 3
- 2023A User Study on Explainable Online Reinforcement Learning for Adaptive Systemscited by 3
- 2025Rethinking Group Recommender Systems in the Era of Generative AI: From One-Shot Recommendations to Agentic Group Decision Supportcited by 3
- 2023Visualization for Recommendation Explainability: A Survey and New Perspectivescited by 2
- 2023The Case Against Explainabilitycited by 2
- 2023On the Multiple Roles of Ontologies in Explainable AIcited by 2
- 2021Two4Two: Evaluating Interpretable Machine Learning - A Synthetic Dataset For Controlled Experimentscited by 1
- 2021Knowledge-based XAI through CBR: There is more to explanations than models can tellcited by 1
- 2022Multi-Objective Recommender Systems: Survey and Challengescited by 1
- 2022Justification of Recommender Systems Results: A Service-based Approachcited by 1
- 2023Software Doping Analysis for Human Oversightcited by 1
- 2024Whom do Explanations Serve? A Systematic Literature Survey of User Characteristics in Explainable Recommender Systems Evaluationcited by 1
- 2025Bayesian-Guided Diversity in Sequential Sampling for Recommender Systemscited by 1
- 2021Designing Explanations for Group Recommender Systemscited by 0
- 2021Towards an Explanation Space to Align Humans and Explainable-AI Teamworkcited by 0
- 2023A System's Approach Taxonomy for User-Centred XAI: A Surveycited by 0
- 2023Balancing Explainability-Accuracy of Complex Modelscited by 0
- 2024Explainable AI: Definition and attributes of a good explanation for health AIcited by 0
- 2025"Even explanations will not help in trusting [this] fundamentally biased system": A Predictive Policing Case-Studycited by 0
- 2025Enhancing Live Broadcast Engagement: A Multi-modal Approach to Short Video Recommendations Using MMGCN and User Preferencescited by 0
- 2025When Transformers Meet Recommenders: Integrating Self-Attentive Sequential Recommendation with Fine-Tuned LLMscited by 0
- 2025Skill-based Explanations for Serendipitous Course Recommendationcited by 0
- 2026Visual or Textual: Effects of Explanation Format and Personal Characteristics on the Perception of Explanations in an Educational Recommender Systemcited by 0
- 2026Investigating the Effects of Different Levels of User Control in an Interactive Educational Recommender Systemcited by 0
- 2026Nudging Sustainable Choices through LLM-Generated Recommendation Explanationscited by 0
- 2026Nudging Sustainable Choices through LLM-Generated Recommendation Explanations28 Jul 2026
- 2026Investigating the Effects of Different Levels of User Control in an Interactive Educational Recommender System2 May 2026
- 2026Visual or Textual: Effects of Explanation Format and Personal Characteristics on the Perception of Explanations in an Educational Recommender System26 Mar 2026
- 2025Skill-based Explanations for Serendipitous Course Recommendation27 Aug 2025
- 2025When Transformers Meet Recommenders: Integrating Self-Attentive Sequential Recommendation with Fine-Tuned LLMs8 Jul 2025
- 2025Rethinking Group Recommender Systems in the Era of Generative AI: From One-Shot Recommendations to Agentic Group Decision Support1 Jul 2025
- 2025Enhancing Live Broadcast Engagement: A Multi-modal Approach to Short Video Recommendations Using MMGCN and User Preferences29 Jun 2025
- 2025Bayesian-Guided Diversity in Sequential Sampling for Recommender Systems22 Jun 2025
- 2025"Even explanations will not help in trusting [this] fundamentally biased system": A Predictive Policing Case-Study15 Apr 2025
- 2024Whom do Explanations Serve? A Systematic Literature Survey of User Characteristics in Explainable Recommender Systems Evaluation12 Dec 2024
- 2024Explainable AI: Definition and attributes of a good explanation for health AI9 Sep 2024
- 2024How Human-Centered Explainable AI Interface Are Designed and Evaluated: A Systematic Survey21 Mar 2024
33 more
- 2024Unpacking Human-AI interactions: From interaction primitives to a design space10 Jan 2024
- 2023On the Multiple Roles of Ontologies in Explainable AI8 Nov 2023
- 2023Co-audit: tools to help humans double-check AI-generated content2 Oct 2023
- 2023Software Doping Analysis for Human Oversight11 Aug 2023
- 2023A User Study on Explainable Online Reinforcement Learning for Adaptive Systems9 Jul 2023
- 2023Two-Stage Holistic and Contrastive Explanation of Image Classification10 Jun 2023
- 2023Justification vs. Transparency: Why and How Visual Explanations in a Scientific Literature Recommender System26 May 2023
- 2023Balancing Explainability-Accuracy of Complex Models23 May 2023
- 2023The Case Against Explainability20 May 2023
- 2023Visualization for Recommendation Explainability: A Survey and New Perspectives19 May 2023
- 2023Trust and Transparency in Recommender Systems17 Apr 2023
- 2023Is More Always Better? The Effects of Personal Characteristics and Level of Detail on the Perception of Explanations in a Recommender System3 Apr 2023
- 2023A System's Approach Taxonomy for User-Centred XAI: A Survey6 Mar 2023
- 2023Invisible Users: Uncovering End-Users' Requirements for Explainable AI via Explanation Forms and Goals10 Feb 2023
- 2022What Makes a Good Explanation?: A Harmonized View of Properties of Explanations10 Nov 2022
- 2022Justification of Recommender Systems Results: A Service-based Approach7 Nov 2022
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanations20 Oct 2022
- 2022Multi-Objective Recommender Systems: Survey and Challenges19 Oct 2022
- 2022An Explainable Decision Support System for Predictive Process Analytics26 Jul 2022
- 2022Fairness in Recommender Systems: Research Landscape and Future Directions23 May 2022
- 2022Explainability in Process Outcome Prediction: Guidelines to Obtain Interpretable and Faithful Models30 Mar 2022
- 2022Explainability in Music Recommender Systems25 Jan 2022
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI20 Jan 2022
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunities11 Nov 2021
- 2021Knowledge-based XAI through CBR: There is more to explanations than models can tell23 Aug 2021
- 2021Towards an Explanation Space to Align Humans and Explainable-AI Teamwork2 Jun 2021
- 2021Yes We Care! -- Certification for Machine Learning Methods through the Care Label Framework21 May 2021
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Concepts15 May 2021
- 2021Two4Two: Evaluating Interpretable Machine Learning - A Synthetic Dataset For Controlled Experiments6 May 2021
- 2021Designing Explanations for Group Recommender Systems24 Feb 2021
- 2021Intuitively Assessing ML Model Reliability through Example-Based Explanations and Editing Model Inputs17 Feb 2021
- 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Research15 Feb 2021
- 2021Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needs24 Jan 2021
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 90
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2021Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needscited by 64
- 2022Fairness in Recommender Systems: Research Landscape and Future Directionscited by 30
- 2022What Makes a Good Explanation?: A Harmonized View of Properties of Explanationscited by 21
- 2022Explainability in Music Recommender Systemscited by 15
- 2021Intuitively Assessing ML Model Reliability through Example-Based Explanations and Editing Model Inputscited by 9
- 2022An Explainable Decision Support System for Predictive Process Analyticscited by 8
- 2023Is More Always Better? The Effects of Personal Characteristics and Level of Detail on the Perception of Explanations in a Recommender Systemcited by 8
12 most cited of 44 All 44 (JSON)
- 2026Nudging Sustainable Choices through LLM-Generated Recommendation Explanations28 Jul 2026
- 2026Investigating the Effects of Different Levels of User Control in an Interactive Educational Recommender System2 May 2026
- 2026Visual or Textual: Effects of Explanation Format and Personal Characteristics on the Perception of Explanations in an Educational Recommender System26 Mar 2026
- 2025Skill-based Explanations for Serendipitous Course Recommendation27 Aug 2025
- 2025When Transformers Meet Recommenders: Integrating Self-Attentive Sequential Recommendation with Fine-Tuned LLMs8 Jul 2025
- 2025Enhancing Live Broadcast Engagement: A Multi-modal Approach to Short Video Recommendations Using MMGCN and User Preferences29 Jun 2025
- 2025Bayesian-Guided Diversity in Sequential Sampling for Recommender Systems22 Jun 2025
- 2025"Even explanations will not help in trusting [this] fundamentally biased system": A Predictive Policing Case-Study15 Apr 2025
- 2024Whom do Explanations Serve? A Systematic Literature Survey of User Characteristics in Explainable Recommender Systems Evaluation12 Dec 2024
- 2024Explainable AI: Definition and attributes of a good explanation for health AI9 Sep 2024
- 2024How Human-Centered Explainable AI Interface Are Designed and Evaluated: A Systematic Survey21 Mar 2024
- 2024Unpacking Human-AI interactions: From interaction primitives to a design space10 Jan 2024
12 newest of 44 All 44 (JSON)