UniER: A Unified Benchmark for Item-level and Path-level Exercise Recommendation
Not on the map. Why?
Abstract (arXiv)
Personalized exercise recommendation dynamically aligns pedagogical resources with individual knowledge mastery, which is crucial for satisfying students' dynamic learning needs in modern education. The field is currently driven by two dominant paradigms: Item-Level Exercise Recommendation (ILER) optimizes for immediate single-step state transitions, while Path-Level Exercise Recommendation (PLER) constructs coherent learning paths to maximize cumulative gains. Despite sharing the same ultimate objective, disparate evaluation setups have kept these two lines of research isolated, hindering unified benchmarking and fair comparison. To fill the gap, in this paper, we present a Unified Benchmark for Exercise Recommendation (UniER), a comprehensive evaluation framework that unifies ILER and PLER. Specifically, we introduce Weighted Cognitive Gain (WCG) as a unified metric to measure cross-paradigm algorithmic performance. Our benchmark encompasses 9 datasets spanning four generation methods, facilitating the comparison of 18 representative ILER/PLER methods. Through multi-dimensional analyses covering effectiveness, generalizability, robustness, and efficiency, our results reveal the systematic dominance of PLER and expose the pedagogical failure of ILER's fragmented recommendations under extreme sparsity and noise. Furthermore, we provide an open-source codebase of UniER to foster reproducible research and outline potential directions for future investigations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 38 references that are in the map. First posted on arXiv 16 May 2026.
Builds on
17 of 38 references.
References · 17
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015Deep Knowledge Tracingcited by 332
- 2020Context-Aware Attentive Knowledge Tracingcited by 174
- 2019Knowledge Tracing with Sequential Key-Value Memory Networkscited by 60
- 2022pyKT: A Python Library to Benchmark Deep Learning based Knowledge Tracing Modelscited by 52
- 2023simpleKT: A Simple But Tough-to-Beat Baseline for Knowledge Tracingcited by 47
- 2024Large Language Models-guided Dynamic Adaptation for Temporal Knowledge Graph Reasoningcited by 41
- 2019Exploiting Cognitive Structure for Adaptive Learningcited by 37
- 2023Unraveling Privacy Risks of Individual Fairness in Graph Neural Networkscited by 16
- 2025Uncertainty-Aware Graph Neural Networks: A Multi-Hop Evidence Fusion Approachcited by 14
- 2023Set-to-Sequence Ranking-based Concept-aware Learning Path Recommendationcited by 9
- 2024IME: Integrating Multi-curvature Shared and Specific Embedding for Temporal Knowledge Graph Completioncited by 9
5 more
- 2025GraphRAG-Induced Dual Knowledge Structure Graphs for Personalized Learning Path Recommendationcited by 6
- 2024User-item fairness tradeoffs in recommendationscited by 5
- 2025NR4DER: Neural Re-ranking for Diversified Exercise Recommendationcited by 5
- 2021RLTutor: Reinforcement Learning Based Adaptive Tutoring System by Modeling Virtual Student with Fewer Interactionscited by 3
- 2024Understanding and Improving Adversarial Collaborative Filtering for Robust Recommendationcited by 2
Built on by
Not cited yet.