A Survey of Explainable Knowledge Tracing
Not on the map. Why?
Abstract (arXiv)
With the long term accumulation of high quality educational data, artificial intelligence has shown excellent performance in knowledge tracing. However, due to the lack of interpretability and transparency of some algorithms, this approach will result in reduced stakeholder trust and a decreased acceptance of intelligent decisions. Therefore, algorithms need to achieve high accuracy, and users need to understand the internal operating mechanism and provide reliable explanations for decisions. This paper thoroughly analyzes the interpretability of KT algorithms. First, the concepts and common methods of explainable artificial intelligence and knowledge tracing are introduced. Next, explainable knowledge tracing models are classified into two categories: transparent models and black box models. Then, the interpretable methods used are reviewed from three stages: ante hoc interpretable methods, post hoc interpretable methods, and other dimensions. It is worth noting that current evaluation methods for explainable knowledge tracing are lacking. Hence, contrast and deletion experiments are conducted to explain the prediction results of the deep knowledge tracing model on the ASSISTment2009 by using three XAI methods. Moreover, this paper offers some insights into evaluation methods from the perspective of educational stakeholders. This paper provides a detailed and comprehensive review of the research on explainable knowledge tracing, aiming to offer some basis and inspiration for researchers interested in the interpretability of knowledge tracing.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 61 of its 212 references that are in the map. First posted on arXiv 12 Mar 2024.
Builds on
61 of 212 references.
References · 61
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2020Knowledge Distillation: A Surveycited by 1,603
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
38 more
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2017SmoothGrad: removing noise by adding noisecited by 1,109
- 2014Striving for Simplicity: The All Convolutional Netcited by 990
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
- 2016The Mythos of Model Interpretabilitycited by 721
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 627
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2015Deep Knowledge Tracingcited by 332
- 2020Neural Additive Models: Interpretable Machine Learning with Neural Netscited by 319
- 2020Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlookscited by 316
- 2016Not Just a Black Box: Learning Important Features Through Propagating Activation Differencescited by 297
- 2018Metrics for Explainable AI: Challenges and Prospectscited by 260
- 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 254
- 2020A Survey on Causal Inferencecited by 202
- 2020Context-Aware Attentive Knowledge Tracingcited by 174
- 2019A Self-Attentive model for Knowledge Tracingcited by 172
- 2016Dynamic Key-Value Memory Networks for Knowledge Tracingcited by 171
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 156
- 2015Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction modelcited by 140
- 2022OpenXAI: Towards a Transparent Evaluation of Model Explanationscited by 126
- 2019EKT: Exercise-aware Knowledge Tracing for Student Performance Predictioncited by 109
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2020The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategiescited by 92
- 2020Causal Interpretability for Machine Learning -- Problems, Methods and Evaluationcited by 82
- 2020Towards an Appropriate Query, Key, and Value Computation for Knowledge Tracingcited by 81
- 2022Knowledge Tracing: A Surveycited by 77
- 2017Beyond Sparsity: Tree Regularization of Deep Models for Interpretabilitycited by 68
- 2020RKT : Relation-Aware Self-Attention for Knowledge Tracingcited by 62
- 2016"What is Relevant in a Text Document?": An Interpretable Machine Learning Approachcited by 53
- 2019Deep-IRT: Make Deep Learning Based Knowledge Tracing Explainable Using Item Response Theorycited by 51
- 2021A Framework for Learning Ante-hoc Explainable Models via Conceptscited by 45
- 2018Knowledge Tracing Machines: Factorization Machines for Knowledge Tracingcited by 42
- 2019Dual Graph Attention Networks for Deep Latent Representation of Multifaceted Social Effects in Recommender Systemscited by 41
- 2023Improving Interpretability of Deep Sequential Knowledge Tracing Models with Question-centric Cognitive Representationscited by 32
- 2016Making Tree Ensembles Interpretable: A Bayesian Model Selection Approachcited by 27
- 2019DAS3H: Modeling Student Learning and Forgetting for Optimally Scheduling Distributed Practice of Skillscited by 27
- 2019Knowledge Query Network: How Knowledge Interacts with Skillscited by 23
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 3.
7 papers.
- 2025Problems With Large Language Models for Learner Modelling: Why LLMs Alone Fall Short for Responsible Tutoring in K--12 Educationcited by 2
- 2024Evolvable Psychology Informed Neural Network for Memory Behavior Modelingcited by 1
- 2026Neural-Symbolic Knowledge Tracing: Injecting Educational Knowledge into Deep Learning for Responsible Learner Modellingcited by 1
- 2025Extracting Causal Relations in Deep Knowledge Tracingcited by 0
- 2025CleverBirds: A Multiple-Choice Benchmark for Fine-grained Human Knowledge Tracingcited by 0
- 2026KTCF: Actionable Recourse in Knowledge Tracing via Counterfactual Explanations for Educationcited by 0
- 2026MOSAIC: Orchestrating Collaborative Knowledge Tracing with Hierarchical Semantic Alignmentcited by 0
- 2026MOSAIC: Orchestrating Collaborative Knowledge Tracing with Hierarchical Semantic Alignment27 Jun 2026
- 2026Neural-Symbolic Knowledge Tracing: Injecting Educational Knowledge into Deep Learning for Responsible Learner Modelling9 Apr 2026
- 2026KTCF: Actionable Recourse in Knowledge Tracing via Counterfactual Explanations for Education14 Jan 2026
- 2025Problems With Large Language Models for Learner Modelling: Why LLMs Alone Fall Short for Responsible Tutoring in K--12 Education28 Dec 2025
- 2025CleverBirds: A Multiple-Choice Benchmark for Fine-grained Human Knowledge Tracing11 Nov 2025
- 2025Extracting Causal Relations in Deep Knowledge Tracing6 Nov 2025
- 2024Evolvable Psychology Informed Neural Network for Memory Behavior Modeling23 Aug 2024