A Training-Free Large Reasoning Model-based Knowledge Tracing Framework for Unified Prediction and Prescription
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Knowledge Tracing (KT) aims to estimate a learner's evolving mastery based on interaction histories. Recent studies have explored Large Language Models (LLMs) for KT via autoregressive nature, but such approaches typically require fine-tuning and exhibit unstable or near-random performance. Moreover, prior KT systems primarily focus on prediction and rely on multi-stage pipelines for feedback and recommendation, resulting in increased system complexity and resources. To address this gap, we propose Thinking-KT, a training-free KT framework that incorporates Test-Time Scaling (TTS), enabling even small LLMs to achieve competitive KT performance. Moreover, in this framework, a small LLM can jointly perform KT prediction, personalized feedback generation, and learning recommendation in a unified output without degrading prediction accuracy. Beyond performance, we present the systematic analysis of reasoning traces in KT. Our results demonstrate that TTS is a critical yet underexplored factor in LLM-based KT, and that small LLMs can serve as unified ITS engines.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 8 of its 39 references that are in the map. First posted on arXiv 5 Jan 2026.
Builds on
8 of 39 references.
References · 8
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024OpenAI o1 System Cardcited by 1,244
- 2024Language Model Can Do Knowledge Tracing: Simple but Effective Method to Integrate Language Model and Knowledge Tracing Taskcited by 21
- 2024CLST: Cold-Start Mitigation in Knowledge Tracing by Aligning a Generative Language Model as a Students' Knowledge Tracercited by 17
- 2022DBE-KT22: A Knowledge Tracing Dataset Based on Online Student Evaluationcited by 5
- 2024A Systematic Review of Knowledge Tracing and Large Language Models in Education: Opportunities, Issues, and Future Researchcited by 3
- 2024Not All Options Are Created Equal: Textual Option Weighting for Token-Efficient LLM-Based Knowledge Tracingcited by 2
- 2025FlatFormer: A Flat Transformer Knowledge Tracing Model Based on Cognitive Bias Injectioncited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Efficient Test-Time Scaling via Temporal Reasoning Aggregation
- 2025RouterKT: Mixture-of-Experts for Knowledge Tracing
- 2026RAG-KT: Cross-platform Explainable Knowledge Tracing with Multi-view Fusion Retrieval Generation
- 2025LLM-KT: Aligning Large Language Models with Knowledge Tracing using a Plug-and-Play Instruction
- 2025LLM-driven Effective Knowledge Tracing by Integrating Dual-channel Difficulty
- 2026KDFP: A first-principles approach to knowledge distillation in large language models
- 2025The Art of Scaling Test-Time Compute for Large Language Models
- 2025On the Generalization vs Fidelity Paradox in Knowledge Distillation