mlsanityData to 14 Oct 2026

Instructions and Guide for Diagnostic Questions: The NeurIPS 2020 Education Challenge

arXiv 2007.12061 ↗First posted 23 Jul 2020cs.CY cs.HC cs.LGcited by 64

Not on the map. Why?

Abstract (arXiv)

Digital technologies are becoming increasingly prevalent in education, enabling personalized, high quality education resources to be accessible by students across the world. Importantly, among these resources are diagnostic questions: the answers that the students give to these questions reveal key information about the specific nature of misconceptions that the students may hold. Analyzing the massive quantities of data stemming from students' interactions with these diagnostic questions can help us more accurately understand the students' learning status and thus allow us to automate learning curriculum recommendations. In this competition, participants will focus on the students' answer records to these multiple-choice diagnostic questions, with the aim of 1) accurately predicting which answers the students provide; 2) accurately predicting which questions have high quality; and 3) determining a personalized sequence of questions for each student that best predicts the student's answers. These tasks closely mimic the goals of a real-world educational platform and are highly representative of the educational challenges faced today. We provide over 20 million examples of students' answers to mathematics questions from Eedi, a leading educational platform which thousands of students interact with daily around the globe. Participants to this competition have a chance to make a lasting, real-world impact on the quality of personalized education for millions of students across the world.

Key facts. Cited by 64 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Jul 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 11; 2022: 2; 2023: 8; 2024: 16; 2025: 13; 2026: 14.

64 papers.

Sort:

By area:

  1. 2022pyKT: A Python Library to Benchmark Deep Learning based Knowledge Tracing Modelscited by 52
  2. 2023simpleKT: A Simple But Tough-to-Beat Baseline for Knowledge Tracingcited by 47
  3. 2023Improving Interpretability of Deep Sequential Knowledge Tracing Models with Question-centric Cognitive Representationscited by 32
  4. 2021A Survey of Knowledge Tracing: Models, Variants, and Applicationscited by 30
  5. 2021Identifiable Generative Models for Missing Not at Random Data Imputationcited by 30
  6. 2021Reinforcement Learning for Education: Opportunities and Challengescited by 25
  7. 2023Enhancing Deep Knowledge Tracing with Auxiliary Taskscited by 24
  8. 2021BOBCAT: Bilevel Optimization-Based Computerized Adaptive Testingcited by 22
  9. 2024Towards Robust Knowledge Tracing Models via k-Sparse Attentioncited by 19
  10. 2024Psychometric Alignment: Capturing Human Knowledge Distributions via Language Modelscited by 18
  11. 2024CLST: Cold-Start Mitigation in Knowledge Tracing by Aligning a Generative Language Model as a Students' Knowledge Tracercited by 17
  12. 2024Inductive Cognitive Diagnosis for Fast Student Learning in Web-Based Online Intelligent Education Systemscited by 16
38 more
  1. 2024Predictive, scalable and interpretable knowledge tracing on structured domainscited by 13
  2. 2021Option Tracing: Beyond Correctness Analysis in Knowledge Tracingcited by 11
  3. 2024Automated Knowledge Concept Annotation and Question Representation Learning for Knowledge Tracingcited by 11
  4. 2021PEEK: A Large Dataset of Learner Engagement with Educational Videoscited by 9
  5. 2023Symbolic Cognitive Diagnosis via Hybrid Optimization for Intelligent Education Systemscited by 7
  6. 2025LLM-KT: Aligning Large Language Models with Knowledge Tracing using a Plug-and-Play Instructioncited by 7
  7. 2025Adaptive Elicitation of Latent Information Using Natural Languagecited by 7
  8. 2024Survey of Computerized Adaptive Testing: A Machine Learning Perspectivecited by 6
  9. 2024A Question-centric Multi-experts Contrastive Learning Framework for Improving the Accuracy and Interpretability of Deep Sequential Knowledge Tracing Modelscited by 5
  10. 2024RIGL: A Unified Reciprocal Approach for Tracing the Independent and Group Learning Processescited by 5
  11. 2022NeurIPS Competition Instructions and Guide: Causal Insights for Learning Paths in Educationcited by 4
  12. 2023Interpretable Knowledge Tracing via Response Influence-based Counterfactual Reasoningcited by 4
  13. 2025Personalized Exercise Recommendation with Semantically-Grounded Knowledge Tracingcited by 4
  14. 2025Next Token Knowledge Tracing: Exploiting Pretrained LLM Representations to Decode Student Behaviourcited by 4
  15. 2026FoundationalASSIST: An Educational Dataset for Foundational Knowledge Tracing and Pedagogical Grounding of LLMscited by 4
  16. 2026Skill Neologisms: Towards Skill-based Continual Learningcited by 4
  17. 2021Contextual HyperNetworks for Novel Feature Adaptationcited by 3
  18. 2021Causally Constrained Data Synthesis for Private Data Releasecited by 3
  19. 2024Improving Low-Resource Knowledge Tracing Tasks by Supervised Pre-training and Importance Mechanism Fine-tuningcited by 3
  20. 2024Collaborative Cognitive Diagnosis with Disentangled Representation Learning for Learner Modelingcited by 3
  21. 2025Teaching According to Students' Aptitude: Personalized Mathematics Tutoring via Persona-, Memory-, and Forgetting-Aware LLMscited by 3
  22. 2021Assessing the Performance of Online Students -- New Data, New Approaches, Improved Accuracycited by 2
  23. 2024DISCO: A Hierarchical Disentangled Cognitive Diagnosis Framework for Interpretable Job Recommendationcited by 2
  24. 2024A Dual-Fusion Cognitive Diagnosis Framework for Open Student Learning Environmentscited by 2
  25. 2026Behavior-Aware Item Modeling via Dynamic Procedural Solution Representations for Knowledge Tracingcited by 2
  26. 2026From Text to Parameters: Predicting Item Parameters from Embedding Regularization with Reliability and Design Ceilingscited by 2
  27. 2023Quiz-based Knowledge Tracingcited by 1
  28. 2023Addressing Selection Bias in Computerized Adaptive Testing: A User-Wise Aggregate Influence Function Approachcited by 1
  29. 2024Enhancing Cognitive Diagnosis by Modeling Learner Cognitive Structure Statecited by 1
  30. 2025CIKT: A Collaborative and Iterative Knowledge Tracing Framework with Large Language Modelscited by 1
  31. 2025Language Bottleneck Models for Qualitative Knowledge State Modelingcited by 1
  32. 2025Just Read the Question: Enabling Generalization to New Assessment Items with Text Awarenesscited by 1
  33. 2025Prompt Optimization Across Multiple Agents for Representing Diverse Human Populationscited by 1
  34. 2025Graph-Based Alternatives to LLMs for Human Simulationcited by 1
  35. 2026Misconception Diagnosis From Student-Tutor Dialogue: Generate, Retrieve, Rerankcited by 1
  36. 2026RAG-KT: Cross-platform Explainable Knowledge Tracing with Multi-view Fusion Retrieval Generationcited by 1
  37. 2026KG-SoftMAP: Soft Knowledge-Graph Priors for Bayesian Network Structure Learning from Sparse Discrete Datacited by 1
  38. 2021CoRGi: Content-Rich Graph Neural Networks with Attentioncited by 0

50 most cited of 64 All 64 (JSON)