DGEKT: A Dual Graph Ensemble Learning Method for Knowledge Tracing
On the map: Knowledge distillation → General knowledge distillation methods
Abstract (arXiv)
Knowledge tracing aims to trace students' evolving knowledge states by predicting their future performance on concept-related exercises. Recently, some graph-based models have been developed to incorporate the relationships between exercises to improve knowledge tracing, but only a single type of relationship information is generally explored. In this paper, we present a novel Dual Graph Ensemble learning method for Knowledge Tracing (DGEKT), which establishes a dual graph structure of students' learning interactions to capture the heterogeneous exercise-concept associations and interaction transitions by hypergraph modeling and directed graph modeling, respectively. To ensemble the dual graph models, we introduce the technique of online knowledge distillation, due to the fact that although the knowledge tracing model is expected to predict students' responses to the exercises related to different concepts, it is optimized merely with respect to the prediction accuracy on a single exercise at each step. With online knowledge distillation, the dual graph models are adaptively combined to form a stronger teacher model, which in turn provides its predictions on all exercises as extra supervision for better modeling ability. In the experiments, we compare DGEKT against eight knowledge tracing baselines on three benchmark datasets, and the results demonstrate that DGEKT achieves state-of-the-art performance.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in General knowledge distillation methods, one of 12 directions in Knowledge distillation. Builds on 30 of its 57 references that are in the map. First posted on arXiv 23 Nov 2022.
Builds on
30 of 57 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2020Knowledge Distillation: A Surveycited by 1,603
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
- 2019When Does Label Smoothing Help?cited by 988
- 2017Deep Mutual Learningcited by 628
- 2018Hypergraph Neural Networkscited by 488
- 2015Deep Knowledge Tracingcited by 332
18 more
- 2020Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlookscited by 316
- 2017Neural Attentive Session-based Recommendationcited by 237
- 2018Knowledge Distillation by On-the-Fly Native Ensemblecited by 186
- 2020Context-Aware Attentive Knowledge Tracingcited by 174
- 2019A Self-Attentive model for Knowledge Tracingcited by 172
- 2016Dynamic Key-Value Memory Networks for Knowledge Tracingcited by 171
- 2018Large scale distributed neural network training through online distillationcited by 146
- 2019EKT: Exercise-aware Knowledge Tracing for Student Performance Predictioncited by 109
- 2019EdNet: A Large-Scale Hierarchical Dataset in Educationcited by 108
- 2021MagNet: A Neural Network for Directed Graphscited by 107
- 2021Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendationcited by 101
- 2020Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendationcited by 75
- 2019Knowledge Tracing with Sequential Key-Value Memory Networkscited by 60
- 2018Knowledge Tracing Machines: Factorization Machines for Knowledge Tracingcited by 42
- 2020Improving Knowledge Tracing via Pre-training Question Embeddingscited by 36
- 2021Learning Elastic Embeddings for Customizing On-Device Recommenderscited by 19
- 2021Results and Insights from Diagnostic Questions: The NeurIPS 2020 Education Challengecited by 18
- 2021Option Tracing: Beyond Correctness Analysis in Knowledge Tracingcited by 11
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 4; 2026: 2.
9 papers.
- 2024Automated Knowledge Concept Annotation and Question Representation Learning for Knowledge Tracingcited by 11
- 2023Towards Goal-oriented Intelligent Tutoring Systems in Online Educationcited by 7
- 2025DKT2: Revisiting Applicable and Comprehensive Knowledge Tracing in Large-Scale Datacited by 4
- 2025Personalized Exercise Recommendation with Semantically-Grounded Knowledge Tracingcited by 4
- 2023A Comprehensive Survey on Deep Learning Techniques in Educational Data Miningcited by 3
- 2025Efficient Knowledge Tracing Leveraging Higher-Order Information in Integrated Graphscited by 0
- 2025KeenKT: Knowledge Mastery-State Disambiguation for Knowledge Tracingcited by 0
- 2026MAGE-KT: Multi-Agent Graph-Enhanced Knowledge Tracing with Subgraph Retrieval and Asymmetric Fusioncited by 0
- 2026SRJudge: Empowering Large Language Models with Selective Reasoning for Fine-Grained Knowledge Concept Taggingcited by 0
- 2026SRJudge: Empowering Large Language Models with Selective Reasoning for Fine-Grained Knowledge Concept Tagging29 Sep 2026
- 2026MAGE-KT: Multi-Agent Graph-Enhanced Knowledge Tracing with Subgraph Retrieval and Asymmetric Fusion23 Jan 2026
- 2025KeenKT: Knowledge Mastery-State Disambiguation for Knowledge Tracing21 Dec 2025
- 2025Efficient Knowledge Tracing Leveraging Higher-Order Information in Integrated Graphs24 Jul 2025
- 2025Personalized Exercise Recommendation with Semantically-Grounded Knowledge Tracing15 Jul 2025
- 2025DKT2: Revisiting Applicable and Comprehensive Knowledge Tracing in Large-Scale Data24 Jan 2025
- 2024Automated Knowledge Concept Annotation and Question Representation Learning for Knowledge Tracing2 Oct 2024
- 2023Towards Goal-oriented Intelligent Tutoring Systems in Online Education3 Dec 2023
- 2023A Comprehensive Survey on Deep Learning Techniques in Educational Data Mining9 Sep 2023
Similar, not cited
Close in wording, no citation either way
- 2022Unified and Effective Ensemble Knowledge Distillation
- 2024Mamba4KT:An Efficient and Effective Mamba-based Knowledge Tracing Model
- 2022Automated Graph Self-supervised Learning via Multi-teacher Knowledge Distillation
- 2023Knowledge Distillation via Token-level Relationship Graph
- 2021Student Network Learning via Evolutionary Knowledge Distillation
- 2025RouterKT: Mixture-of-Experts for Knowledge Tracing
- 2022Learn From the Past: Experience Ensemble Knowledge Distillation
- 2025LLM-driven Effective Knowledge Tracing by Integrating Dual-channel Difficulty