mlsanityData to 14 Oct 2026

Not All Options Are Created Equal: Textual Option Weighting for Token-Efficient LLM-Based Knowledge Tracing

arXiv 2410.12872 ↗First posted 14 Oct 2024cs.CL cs.AI cs.CYcited by 2

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have recently emerged as promising tools for knowledge tracing (KT) due to their strong reasoning and generalization abilities. While recent LLM-based KT methods have proposed new prompt formats, they struggle to represent the full interaction histories of example learners within a single prompt during in-context learning (ICL), resulting in limited scalability and high computational cost under token constraints. In this work, we present textitLLM-based Option-weighted Knowledge Tracing (LOKT), a simple yet effective framework that encodes the interaction histories of example learners in context as textittextual categorical option weights (TCOW). TCOW are semantic labels (e.g., ``inadequate'') assigned to the options selected by learners when answering questions, enhancing the interpretability of LLMs. Experiments on multiple-choice datasets show that LOKT outperforms existing non-LLM and LLM-based KT models in both cold-start and warm-start settings. Moreover, LOKT enables scalable and cost-efficient inference, achieving strong performance even under strict token constraints. Our code is available at hrefhttps://anonymous.4open.science/r/LOKTmodel-3233https://anonymous.4open.science/r/LOKTmodel-3233.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 14 Oct 2024.

Builds on

13 of 27 references.

References · 13

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023A Survey of Large Language Modelscited by 2,576
  3. 2015Deep Knowledge Tracingcited by 332
  4. 2020Context-Aware Attentive Knowledge Tracingcited by 174
  5. 2016Dynamic Key-Value Memory Networks for Knowledge Tracingcited by 171
  6. 2019EdNet: A Large-Scale Hierarchical Dataset in Educationcited by 108
  7. 2023TCRA-LLM: Token Compression Retrieval Augmented Large Language Model for Inference Cost Reductioncited by 34
  8. 2019Knowledge Query Network: How Knowledge Interacts with Skillscited by 23
  9. 2024Towards Modeling Learner Performance with Large Language Modelscited by 21
  10. 2021Results and Insights from Diagnostic Questions: The NeurIPS 2020 Education Challengecited by 18
  11. 2024CLST: Cold-Start Mitigation in Knowledge Tracing by Aligning a Generative Language Model as a Students' Knowledge Tracercited by 17
  12. 2021Option Tracing: Beyond Correctness Analysis in Knowledge Tracingcited by 11
1 more
  1. 2022No Task Left Behind: Multi-Task Learning of Knowledge Tracing and Option Tracing for Better Student Assessmentcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025LLM-KT: Aligning Large Language Models with Knowledge Tracing using a Plug-and-Play Instruction
  2. 2026MERIT: Memory-Enhanced Retrieval for Interpretable Knowledge Tracing
  3. 2024Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data
  4. 2026Probing the Trajectories of Reasoning Traces in Large Language Models
  5. 2025Optimising Language Models for Downstream Tasks: A Post-Training Perspective
  6. 2023NLPBench: Evaluating Large Language Models on Solving NLP Problems
  7. 2025Trace-of-Thought Prompting: Investigating Prompt-Based Knowledge Distillation Through Question Decomposition
  8. 2025EMCEE: Improving Multilingual Capability of LLMs via Bridging Knowledge and Reasoning with Extracted Synthetic Multilingual Context