mlsanityData to 7 Oct 2026

On-Premises Multi-Course RAG Tutoring for Business Education: Hardware-Software Trade-offs in a Campus AI Tutor

arXiv 2610.02510 ↗First posted 1 Oct 2026cs.AI cs.IRcited by 0

On the map: Retrieval-augmented generation → Agentic RAG, agents and memory also fits: RAG pipeline design and evaluation

Abstract (arXiv)

Campus AI tutors based on retrieval-augmented generation (RAG) must ground answers in assigned course materials while keeping textbooks and student dialogue on institutional infrastructure. We present CourseChat, an on-premises, multi-course RAG tutor for undergraduate business education, deployed behind a campus web gateway and intended for use embedded in Moodle. Six isolated course offerings, each keyed by its own course reference number (CRN), share twin-edge AI hosts running a FastAPI service, a local vector database, and a local large language model (LLM) served by Ollama. We report two generation-model bake-off rounds, a separate fixed-evidence source-fidelity comparison, and conversation and quiz audits. Several larger models failed the classroom speed gate, but a 12B model and a 7B alternative passed. A separate mixture-of-experts candidate improved some corrections while introducing new factual and continuity errors. We therefore retain the 8B production model pending a demonstrated overall improvement, rather than claiming that 8B is universally optimal. Software changes improved follow-up topic resolution while preserving course scope; 435 prebuilt questions across 65 modules decouple practice from live generation. The results support treating model choice, evidence selection, serving compatibility, and product design as a joint engineering decision. They do not establish learning gains: faculty ratings, peak-load capacity, and complete public-gateway acceptance remain separate evaluation needs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. First posted on arXiv 1 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards an Efficient, Customizable, and Accessible AI Tutor
  2. 2026EduGuard: A Safe RAG-Based LLM Tutor for Programming Education ↗
  3. 2025Towards Efficient Educational Chatbots: Benchmarking RAG Frameworks
  4. 2025Machine Assistant with Reliable Knowledge: Enhancing Student Learning via RAG-based Retrieval
  5. 2024Evaluating the Impact of Advanced LLM Techniques on AI-Lecture Tutors for a Robotics Course
  6. 2024CourseAssist: Pedagogically Appropriate AI Tutor for Computer Science Education
  7. 2024Comparing the Utility, Preference, and Performance of Course Material Search Functionality and Retrieval-Augmented Generation Large Language Model (RAG-LLM) AI Chatbots in Information-Seeking Tasks
  8. 2025From Slides to Chatbots: Enhancing Large Language Models with University Course Materials