A Question-centric Multi-experts Contrastive Learning Framework for Improving the Accuracy and Interpretability of Deep Sequential Knowledge Tracing Models
Not on the map. Why?
Abstract (arXiv)
Knowledge tracing (KT) plays a crucial role in predicting students' future performance by analyzing their historical learning processes. Deep neural networks (DNNs) have shown great potential in solving the KT problem. However, there still exist some important challenges when applying deep learning techniques to model the KT process. The first challenge lies in taking the individual information of the question into modeling. This is crucial because, despite questions sharing the same knowledge component (KC), students' knowledge acquisition on homogeneous questions can vary significantly. The second challenge lies in interpreting the prediction results from existing deep learning-based KT models. In real-world applications, while it may not be necessary to have complete transparency and interpretability of the model parameters, it is crucial to present the model's prediction results in a manner that teachers find interpretable. This makes teachers accept the rationale behind the prediction results and utilize them to design teaching activities and tailored learning strategies for students. However, the inherent black-box nature of deep learning techniques often poses a hurdle for teachers to fully embrace the model's prediction results. To address these challenges, we propose a Question-centric Multi-experts Contrastive Learning framework for KT called Q-MCKT. We have provided all the datasets and code on our website at https://github.com/rattlesnakey/Q-MCKT.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 45 of its 80 references that are in the map. First posted on arXiv 12 Mar 2024.
Builds on
45 of 80 references.
References · 45
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
- 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
- 2021Scaling Vision with Sparse Mixture of Expertscited by 740
- 2015Deep Knowledge Tracingcited by 328
- 2021BASE Layers: Simplifying Training of Large, Sparse Modelscited by 315
33 more
- 2020Supervised Contrastive Learning for Pre-trained Language Model Fine-tuningcited by 275
- 2021Efficient Large Scale Language Modeling with Mixtures of Expertscited by 175
- 2020Context-Aware Attentive Knowledge Tracingcited by 172
- 2016Dynamic Key-Value Memory Networks for Knowledge Tracingcited by 170
- 2019A Self-Attentive model for Knowledge Tracingcited by 169
- 2019EKT: Exercise-aware Knowledge Tracing for Student Performance Predictioncited by 109
- 2019EdNet: A Large-Scale Hierarchical Dataset in Educationcited by 106
- 2020Towards an Appropriate Query, Key, and Value Computation for Knowledge Tracingcited by 79
- 2019Neural Cognitive Diagnosis for Intelligent Education Systemscited by 75
- 2020Instructions and Guide for Diagnostic Questions: The NeurIPS 2020 Education Challengecited by 64
- 2020RKT : Relation-Aware Self-Attention for Knowledge Tracingcited by 62
- 2019Knowledge Tracing with Sequential Key-Value Memory Networkscited by 60
- 2018Addressing Two Problems in Deep Knowledge Tracing via Prediction-Consistent Regularizationcited by 53
- 2020GIKT: A Graph-based Interaction Model for Knowledge Tracingcited by 51
- 2022pyKT: A Python Library to Benchmark Deep Learning based Knowledge Tracing Modelscited by 50
- 2019Deep-IRT: Make Deep Learning Based Knowledge Tracing Explainable Using Item Response Theorycited by 48
- 2023simpleKT: A Simple But Tough-to-Beat Baseline for Knowledge Tracingcited by 44
- 2020Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Expertscited by 43
- 2018Knowledge Tracing Machines: Factorization Machines for Knowledge Tracingcited by 42
- 2023Improving Interpretability of Deep Sequential Knowledge Tracing Models with Question-centric Cognitive Representationscited by 32
- 2021Enhancing Knowledge Tracing via Adversarial Trainingcited by 30
- 2020qDKT: Question-centric Deep Knowledge Tracingcited by 24
- 2018Deep Knowledge Tracing and Dynamic Student Classification for Knowledge Tracingcited by 23
- 2023Enhancing Deep Knowledge Tracing with Auxiliary Taskscited by 23
- 2019Knowledge Query Network: How Knowledge Interacts with Skillscited by 22
- 2015Learning Program Embeddings to Propagate Feedback on Student Codecited by 19
- 2022Multitasking Framework for Unsupervised Simple Definition Generationcited by 18
- 2023Multi-level Contrastive Learning for Script-based Character Understandingcited by 15
- 2020Towards Interpretable Deep Learning Models for Knowledge Tracingcited by 13
- 2023Assisting Language Learners: Automated Trans-Lingual Definition Generation via Contrastive Prompt Learningcited by 13
- 2021Multi-Factors Aware Dual-Attentional Knowledge Tracingcited by 12
- 2022Fine-grained Contrastive Learning for Definition Generationcited by 10
- 2024Improving Low-Resource Knowledge Tracing Tasks by Supervised Pre-training and Importance Mechanism Fine-tuningcited by 3
Built on by
Citing papers per year: 2024: 3; 2025: 0; 2026: 2.
5 papers.
- 2024Incremental Residual Concept Bottleneck Modelscited by 43
- 2026Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Modelscited by 22
- 2024Understanding Multimodal Deep Neural Networks: A Concept Selection Viewcited by 4
- 2024Balancing Speciality and Versatility: A Coarse to Fine Framework for Mitigating Catastrophic Forgetting in Large Language Modelscited by 3
- 2026RegKT: Interpretable and Robust Deep Knowledge Tracing With IRT-Regularizercited by 0
- 2026RegKT: Interpretable and Robust Deep Knowledge Tracing With IRT-Regularizer18 Sep 2026
- 2026Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models20 Jan 2026
- 2024Balancing Speciality and Versatility: A Coarse to Fine Framework for Mitigating Catastrophic Forgetting in Large Language Models16 Apr 2024
- 2024Incremental Residual Concept Bottleneck Models13 Apr 2024
- 2024Understanding Multimodal Deep Neural Networks: A Concept Selection View13 Apr 2024