# Context-Aware Attentive Knowledge Tracing

arXiv: https://arxiv.org/abs/2007.12324 · HTML: https://mlsanity.com/paper/2007.12324/

## Key facts

- Cited by 174 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Jul 2020.

## Built on by (most cited first, 30 of 174)

- [Knowledge Tracing: A Survey](https://mlsanity.com/paper/2201.06953/) (2022)
- [pyKT: A Python Library to Benchmark Deep Learning based Knowledge Tracing Models](https://mlsanity.com/paper/2206.11460/) (2022)
- [simpleKT: A Simple But Tough-to-Beat Baseline for Knowledge Tracing](https://mlsanity.com/paper/2302.06881/) (2023)
- [Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMs](https://mlsanity.com/paper/2409.16490/) (2024)
- [Training LLM-based Tutors to Improve Student Learning Outcomes in Dialogues](https://mlsanity.com/paper/2503.06424/) (2025)
- [Improving Interpretability of Deep Sequential Knowledge Tracing Models with Question-centric Cognitive Representations](https://mlsanity.com/paper/2302.06885/) (2023)
- [Enhancing Knowledge Tracing via Adversarial Training](https://mlsanity.com/paper/2108.04430/) (2021)
- [A Survey of Knowledge Tracing: Models, Variants, and Applications](https://mlsanity.com/paper/2105.15106/) (2021)
- [Enhancing Deep Knowledge Tracing with Auxiliary Tasks](https://mlsanity.com/paper/2302.07942/) (2023)
- [Bringing Generative AI to Adaptive Learning in Education](https://mlsanity.com/paper/2402.14601/) (2024)
- [Language Model Can Do Knowledge Tracing: Simple but Effective Method to Integrate Language Model and Knowledge Tracing Task](https://mlsanity.com/paper/2406.02893/) (2024)
- [Towards Robust Knowledge Tracing Models via k-Sparse Attention](https://mlsanity.com/paper/2407.17097/) (2024)
- [Deep Graph Memory Networks for Forgetting-Robust Knowledge Tracing](https://mlsanity.com/paper/2108.08105/) (2021)
- [CLST: Cold-Start Mitigation in Knowledge Tracing by Aligning a Generative Language Model as a Students' Knowledge Tracer](https://mlsanity.com/paper/2406.10296/) (2024)
- [Code-DKT: A Code-based Knowledge Tracing Model for Programming Tasks](https://mlsanity.com/paper/2206.03545/) (2022)
- [Classroom Simulacra: Building Contextual Student Generative Agents in Online Education for Learning Behavioral Simulation](https://mlsanity.com/paper/2502.02780/) (2025)
- [Interpretable Knowledge Tracing: Simple and Efficient Student Modeling with Causal Relations](https://mlsanity.com/paper/2112.11209/) (2021)
- [Personalized Education in the AI Era: What to Expect Next?](https://mlsanity.com/paper/2101.10074/) (2021)
- [Forgetting-aware Linear Bias for Attentive Knowledge Tracing](https://mlsanity.com/paper/2309.14796/) (2023)
- [Predictive, scalable and interpretable knowledge tracing on structured domains](https://mlsanity.com/paper/2403.13179/) (2024)
- [Multi-Factors Aware Dual-Attentional Knowledge Tracing](https://mlsanity.com/paper/2108.04741/) (2021)
- [Disentangled Knowledge Tracing for Alleviating Cognitive Bias](https://mlsanity.com/paper/2503.02539/) (2025)
- [Option Tracing: Beyond Correctness Analysis in Knowledge Tracing](https://mlsanity.com/paper/2104.09043/) (2021)
- [Automated Knowledge Concept Annotation and Question Representation Learning for Knowledge Tracing](https://mlsanity.com/paper/2410.01727/) (2024)
- [Programming Knowledge Tracing: A Comprehensive Dataset and A New Model](https://mlsanity.com/paper/2112.08273/) (2021)
- [DGEKT: A Dual Graph Ensemble Learning Method for Knowledge Tracing](https://mlsanity.com/paper/2211.12881/) (2022)
- [Difficulty-Focused Contrastive Learning for Knowledge Tracing with a Large Language Model-Based Difficulty Prediction](https://mlsanity.com/paper/2312.11890/) (2023)
- [DyGKT: Dynamic Graph Learning for Knowledge Tracing](https://mlsanity.com/paper/2407.20824/) (2024)
- [HiTSKT: A Hierarchical Transformer Model for Session-Aware Knowledge Tracing](https://mlsanity.com/paper/2212.12139/) (2022)
- [Explainable Few-shot Knowledge Tracing](https://mlsanity.com/paper/2405.14391/) (2024)

## Abstract (arXiv)

Knowledge tracing (KT) refers to the problem of predicting future learner performance given their past performance in educational applications. Recent developments in KT using flexible deep neural network-based models excel at this task. However, these models often offer limited interpretability, thus making them insufficient for personalized learning, which requires using interpretable feedback and actionable recommendations to help learners achieve better learning outcomes. In this paper, we propose attentive knowledge tracing (AKT), which couples flexible attention-based neural network models with a series of novel, interpretable model components inspired by cognitive and psychometric models. AKT uses a novel monotonic attention mechanism that relates a learner's future responses to assessment questions to their past responses; attention weights are computed using exponential decay and a context-aware relative distance measure, in addition to the similarity between questions. Moreover, we use the Rasch model to regularize the concept and question embeddings; these embeddings are able to capture individual differences among questions on the same concept without using an excessive number of parameters. We conduct experiments on several real-world benchmark datasets and show that AKT outperforms existing KT methods (by up to 6% in AUC in some cases) on predicting future learner responses. We also conduct several case studies and show that AKT exhibits excellent interpretability and thus has potential for automated feedback and personalization in real-world educational settings.
