mlsanityData to 7 Oct 2026

A Question-centric Multi-experts Contrastive Learning Framework for Improving the Accuracy and Interpretability of Deep Sequential Knowledge Tracing Models

arXiv 2403.07322 ↗First posted 12 Mar 2024cs.CY cs.AI cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Knowledge tracing (KT) plays a crucial role in predicting students' future performance by analyzing their historical learning processes. Deep neural networks (DNNs) have shown great potential in solving the KT problem. However, there still exist some important challenges when applying deep learning techniques to model the KT process. The first challenge lies in taking the individual information of the question into modeling. This is crucial because, despite questions sharing the same knowledge component (KC), students' knowledge acquisition on homogeneous questions can vary significantly. The second challenge lies in interpreting the prediction results from existing deep learning-based KT models. In real-world applications, while it may not be necessary to have complete transparency and interpretability of the model parameters, it is crucial to present the model's prediction results in a manner that teachers find interpretable. This makes teachers accept the rationale behind the prediction results and utilize them to design teaching activities and tailored learning strategies for students. However, the inherent black-box nature of deep learning techniques often poses a hurdle for teachers to fully embrace the model's prediction results. To address these challenges, we propose a Question-centric Multi-experts Contrastive Learning framework for KT called Q-MCKT. We have provided all the datasets and code on our website at https://github.com/rattlesnakey/Q-MCKT.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 45 of its 80 references that are in the map. First posted on arXiv 12 Mar 2024.

Builds on

45 of 80 references.

References · 45

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  5. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  6. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  7. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
  8. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
  9. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  10. 2021Scaling Vision with Sparse Mixture of Expertscited by 740
  11. 2015Deep Knowledge Tracingcited by 328
  12. 2021BASE Layers: Simplifying Training of Large, Sparse Modelscited by 315
33 more
  1. 2020Supervised Contrastive Learning for Pre-trained Language Model Fine-tuningcited by 275
  2. 2021Efficient Large Scale Language Modeling with Mixtures of Expertscited by 175
  3. 2020Context-Aware Attentive Knowledge Tracingcited by 172
  4. 2016Dynamic Key-Value Memory Networks for Knowledge Tracingcited by 170
  5. 2019A Self-Attentive model for Knowledge Tracingcited by 169
  6. 2019EKT: Exercise-aware Knowledge Tracing for Student Performance Predictioncited by 109
  7. 2019EdNet: A Large-Scale Hierarchical Dataset in Educationcited by 106
  8. 2020Towards an Appropriate Query, Key, and Value Computation for Knowledge Tracingcited by 79
  9. 2019Neural Cognitive Diagnosis for Intelligent Education Systemscited by 75
  10. 2020Instructions and Guide for Diagnostic Questions: The NeurIPS 2020 Education Challengecited by 64
  11. 2020RKT : Relation-Aware Self-Attention for Knowledge Tracingcited by 62
  12. 2019Knowledge Tracing with Sequential Key-Value Memory Networkscited by 60
  13. 2018Addressing Two Problems in Deep Knowledge Tracing via Prediction-Consistent Regularizationcited by 53
  14. 2020GIKT: A Graph-based Interaction Model for Knowledge Tracingcited by 51
  15. 2022pyKT: A Python Library to Benchmark Deep Learning based Knowledge Tracing Modelscited by 50
  16. 2019Deep-IRT: Make Deep Learning Based Knowledge Tracing Explainable Using Item Response Theorycited by 48
  17. 2023simpleKT: A Simple But Tough-to-Beat Baseline for Knowledge Tracingcited by 44
  18. 2020Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Expertscited by 43
  19. 2018Knowledge Tracing Machines: Factorization Machines for Knowledge Tracingcited by 42
  20. 2023Improving Interpretability of Deep Sequential Knowledge Tracing Models with Question-centric Cognitive Representationscited by 32
  21. 2021Enhancing Knowledge Tracing via Adversarial Trainingcited by 30
  22. 2020qDKT: Question-centric Deep Knowledge Tracingcited by 24
  23. 2018Deep Knowledge Tracing and Dynamic Student Classification for Knowledge Tracingcited by 23
  24. 2023Enhancing Deep Knowledge Tracing with Auxiliary Taskscited by 23
  25. 2019Knowledge Query Network: How Knowledge Interacts with Skillscited by 22
  26. 2015Learning Program Embeddings to Propagate Feedback on Student Codecited by 19
  27. 2022Multitasking Framework for Unsupervised Simple Definition Generationcited by 18
  28. 2023Multi-level Contrastive Learning for Script-based Character Understandingcited by 15
  29. 2020Towards Interpretable Deep Learning Models for Knowledge Tracingcited by 13
  30. 2023Assisting Language Learners: Automated Trans-Lingual Definition Generation via Contrastive Prompt Learningcited by 13
  31. 2021Multi-Factors Aware Dual-Attentional Knowledge Tracingcited by 12
  32. 2022Fine-grained Contrastive Learning for Definition Generationcited by 10
  33. 2024Improving Low-Resource Knowledge Tracing Tasks by Supervised Pre-training and Importance Mechanism Fine-tuningcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 0; 2026: 2.

5 papers.