mlsanityData to 14 Oct 2026

Curriculum Brain: Constructing Curriculum Knowledge Graphs as a Substrate for Cognitive Diagnosis

arXiv 2610.05860 ↗First posted 5 Oct 2026cs.CY cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Cognitive Diagnostic Models (CDMs) identify which specific skills a student has and has not mastered, the signal a personalized learning path needs and a single aggregate score cannot give. Yet they are rarely deployed. The obstacle is their precondition: the Q-matrix, a mapping from every assessment item to the skills it requires, historically authored by hand. We separate the task into two stages: first construct the curriculum's own knowledge graph, the full space of concepts and skills it contains, independent of any item; then map items against that graph on demand. This paper addresses the first stage only. The item-mapping stage is designed but not implemented here, so the claim that this shifts judgment cost from once per item to once per curriculum is a design rationale rather than a finding. We present Curriculum Brain, a two-repository system pairing a version-controlled knowledge base with an agentic pipeline of eleven single-responsibility agents under a thin deterministic orchestrator. It generates candidate concept-skill mappings from official curriculum documents, checks them against accumulated rules, and compares them with a concept-skill map extracted independently from the textbook, repairing its own failures and escalating to a human only when it cannot resolve a case itself. Across 241 chapter runs (168 distinct chapters), 41.5% produced a Generator output passing both checks without a patch, and 67.6% resolved without escalation. Both are measured against criteria the system itself produced, so both describe internal consistency rather than agreement with an external standard, and both pool two pipeline configurations separated by a single change at run 77; after it the figures are 57.0% and 91.5%. Observed spend was 1.19 per chapter, API spend only, excluding human review. We release both the framework and the resulting curriculum dataset.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 24 references that are in the map. First posted on arXiv 5 Oct 2026.

Builds on

12 of 24 references.

References · 12

  1. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  2. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  3. 2023Large Language Models as Optimizerscited by 864
  4. 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
  5. 2025SCOPE: Prompt Evolution for Enhancing Agent Effectivenesscited by 18
  6. 2025AGENTiGraph: A Multi-Agent Knowledge Graph Framework for Interactive, Domain-Specific LLM Chatbotscited by 10
  7. 2026Environment-Grounded Automated Prompt Optimization for LLM Game Agentscited by 3
  8. 2026K12-KGraph: A Curriculum-Aligned Knowledge Graph for Benchmarking and Training Educational LLMscited by 2
  9. 2026The Use of AI Tools to Develop and Validate Q-Matricescited by 1
  10. 2026Beyond Scores: Diagnostic LLM Evaluation via Fine-Grained Abilitiescited by 1
  11. 2026A Framework for Human-AI Q-Matrix Refinement: A NeuralCDM Evaluationcited by 1
  12. 2026Agentic Knowledge Tracing: A Multi-Agent LLM Architecture for Stealth Assessment of Financial Literacy in Serious Gamescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond ID Embeddings: Process-Grounded Language Modeling for Cognitive Diagnosis
  2. 2026TeachMateGPT: A Multi-Agent Knowledge-Grounded Framework for Pedagogical Assessment Generation from Science Curriculum Materials
  3. 2025Benchmarking Large Language Models for Diagnosing Students' Cognitive Skills from Handwritten Math Work
  4. 2026Cognitive Agent Compilation for Explicit Problem Solver Modeling
  5. 2025From Test-taking to Cognitive Scaffolding: A Pedagogical Diagnostic Benchmark for LLMs on English Standardized Tests
  6. 2025Reasoning Steps as Curriculum: Using Depth of Thought as a Difficulty Signal for Tuning LLMs
  7. 2025Cognitive Structure Generation: From Educational Priors to Policy Optimization
  8. 2026Towards LLM-Empowered Knowledge Tracing via LLM-Student Hierarchical Behavior Alignment in Hyperbolic Space