Small Models, Big Support: A Local LLM Framework for Educator-Centric Content Creation and Assessment with RAG and CAG
Not on the map. Why?
Abstract (arXiv)
While Large Language Models (LLMs) are increasingly applied in student-facing educational tools, their potential to directly support educators through locally deployable and customizable solutions remains underexplored. Many existing approaches rely on proprietary, cloud-based systems that raise significant cost, privacy, and control concerns for educational institutions. To address these barriers, we introduce an end-to-end, open-source framework that empowers educators using small (3B-7B parameter), locally deployable LLMs. Our system is designed for comprehensive teacher support, including customized teaching material generation and AI-assisted assessment. The framework synergistically combines Retrieval-Augmented Generation (RAG) and Context-Augmented Generation (CAG) to produce factually accurate, pedagogically-styled content. A core feature is an interactive refinement loop, a teacher-in-the-loop mechanism that ensures educator agency and precise alignment of the final output. To enhance reliability and safety, an auxiliary verifier LLM inspects all generated content. We validate our framework through a rigorous evaluation of its content generation capabilities and report on a successful technical deployment in a college physics course, which confirms its feasibility on standard institutional hardware. Our findings demonstrate that carefully engineered, self-hosted systems built on small LLMs can provide robust, affordable, and private support for educators, achieving practical utility comparable to much larger models for targeted instructional tasks. This work presents a practical blueprint for the development of sovereign AI tools tailored to the real-world needs of educational institutions.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Jun 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Stan: An LLM-based thermodynamics course assistantcited by 0
- 2026Bounding Boxes to Improve Small Language Model Performance on Vision-Based Grading Taskscited by 0
- 2026TeachMateGPT: A Multi-Agent Knowledge-Grounded Framework for Pedagogical Assessment Generation from Science Curriculum Materialscited by 0
- 2026TeachMateGPT: A Multi-Agent Knowledge-Grounded Framework for Pedagogical Assessment Generation from Science Curriculum Materials13 Aug 2026
- 2026Bounding Boxes to Improve Small Language Model Performance on Vision-Based Grading Tasks21 Jul 2026
- 2026Stan: An LLM-based thermodynamics course assistant4 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Small Language Models for Curriculum-based Guidance
- 2024Faculty Perspectives on the Potential of RAG in Computer Science Higher Education
- 2026An LLM -Powered Assessment Retrieval-Augmented Generation (RAG) For Higher Education
- 2025Towards an Efficient, Customizable, and Accessible AI Tutor
- 2024Leveraging Large Language Models to Generate Course-specific Semantically Annotated Learning Objects
- 2025Aligning LLMs for the Classroom with Knowledge-Based Retrieval -- A Comparative RAG Study
- 2025LLM Agents for Education: Advances and Applications
- 2024Evaluating Students' Open-ended Written Responses with LLMs: Using the RAG Framework for GPT-3.5, GPT-4, Claude-3, and Mistral-Large