mlsanityData to 14 Oct 2026

A Survey of Explainable Knowledge Tracing

arXiv 2403.07279 ↗First posted 12 Mar 2024cs.CLcited by 7

Not on the map. Why?

Abstract (arXiv)

With the long term accumulation of high quality educational data, artificial intelligence has shown excellent performance in knowledge tracing. However, due to the lack of interpretability and transparency of some algorithms, this approach will result in reduced stakeholder trust and a decreased acceptance of intelligent decisions. Therefore, algorithms need to achieve high accuracy, and users need to understand the internal operating mechanism and provide reliable explanations for decisions. This paper thoroughly analyzes the interpretability of KT algorithms. First, the concepts and common methods of explainable artificial intelligence and knowledge tracing are introduced. Next, explainable knowledge tracing models are classified into two categories: transparent models and black box models. Then, the interpretable methods used are reviewed from three stages: ante hoc interpretable methods, post hoc interpretable methods, and other dimensions. It is worth noting that current evaluation methods for explainable knowledge tracing are lacking. Hence, contrast and deletion experiments are conducted to explain the prediction results of the deep knowledge tracing model on the ASSISTment2009 by using three XAI methods. Moreover, this paper offers some insights into evaluation methods from the perspective of educational stakeholders. This paper provides a detailed and comprehensive review of the research on explainable knowledge tracing, aiming to offer some basis and inspiration for researchers interested in the interpretability of knowledge tracing.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 61 of its 212 references that are in the map. First posted on arXiv 12 Mar 2024.

Builds on

61 of 212 references.

References · 61

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  4. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  5. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  6. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  7. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
  8. 2020Knowledge Distillation: A Surveycited by 1,603
  9. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
  10. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  11. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
  12. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
38 more
  1. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
  2. 2017SmoothGrad: removing noise by adding noisecited by 1,109
  3. 2014Striving for Simplicity: The All Convolutional Netcited by 990
  4. 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
  5. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
  6. 2016The Mythos of Model Interpretabilitycited by 721
  7. 2020Transformer Interpretability Beyond Attention Visualizationcited by 627
  8. 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
  9. 2015Deep Knowledge Tracingcited by 332
  10. 2020Neural Additive Models: Interpretable Machine Learning with Neural Netscited by 319
  11. 2020Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlookscited by 316
  12. 2016Not Just a Black Box: Learning Important Features Through Propagating Activation Differencescited by 297
  13. 2018Metrics for Explainable AI: Challenges and Prospectscited by 260
  14. 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 254
  15. 2020A Survey on Causal Inferencecited by 202
  16. 2020Context-Aware Attentive Knowledge Tracingcited by 174
  17. 2019A Self-Attentive model for Knowledge Tracingcited by 172
  18. 2016Dynamic Key-Value Memory Networks for Knowledge Tracingcited by 171
  19. 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 156
  20. 2015Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction modelcited by 140
  21. 2022OpenXAI: Towards a Transparent Evaluation of Model Explanationscited by 126
  22. 2019EKT: Exercise-aware Knowledge Tracing for Student Performance Predictioncited by 109
  23. 2021Trustworthy AI: A Computational Perspectivecited by 93
  24. 2020The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategiescited by 92
  25. 2020Causal Interpretability for Machine Learning -- Problems, Methods and Evaluationcited by 82
  26. 2020Towards an Appropriate Query, Key, and Value Computation for Knowledge Tracingcited by 81
  27. 2022Knowledge Tracing: A Surveycited by 77
  28. 2017Beyond Sparsity: Tree Regularization of Deep Models for Interpretabilitycited by 68
  29. 2020RKT : Relation-Aware Self-Attention for Knowledge Tracingcited by 62
  30. 2016"What is Relevant in a Text Document?": An Interpretable Machine Learning Approachcited by 53
  31. 2019Deep-IRT: Make Deep Learning Based Knowledge Tracing Explainable Using Item Response Theorycited by 51
  32. 2021A Framework for Learning Ante-hoc Explainable Models via Conceptscited by 45
  33. 2018Knowledge Tracing Machines: Factorization Machines for Knowledge Tracingcited by 42
  34. 2019Dual Graph Attention Networks for Deep Latent Representation of Multifaceted Social Effects in Recommender Systemscited by 41
  35. 2023Improving Interpretability of Deep Sequential Knowledge Tracing Models with Question-centric Cognitive Representationscited by 32
  36. 2016Making Tree Ensembles Interpretable: A Bayesian Model Selection Approachcited by 27
  37. 2019DAS3H: Modeling Student Learning and Forgetting for Optimally Scheduling Distributed Practice of Skillscited by 27
  38. 2019Knowledge Query Network: How Knowledge Interacts with Skillscited by 23

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 3.

7 papers.