mlsanityData to 7 Oct 2026

Stan: An LLM-based thermodynamics course assistant

arXiv 2603.04657 ↗First posted 4 Mar 2026cs.CL cs.CY physics.ed-phcited by 0

Not on the map. Why?

Abstract (arXiv)

Discussions of AI in education focus predominantly on student-facing tools -- chatbots, tutors, and problem generators -- while the potential for the same infrastructure to support instructors remains largely unexplored. We describe Stan, a suite of tools for an undergraduate chemical engineering thermodynamics course built on a data pipeline that we develop and deploy in dual roles: serving students and supporting instructors from a shared foundation of lecture transcripts and a structured textbook index. On the student side, a retrieval-augmented generation (RAG) pipeline answers natural-language queries by extracting technical terms, matching them against the textbook index, and synthesizing grounded responses with specific chapter and page references. On the instructor side, the same transcript corpus is processed through structured analysis pipelines that produce per-lecture summaries, identify student questions and moments of confusion, and catalog the anecdotes and analogies used to motivate difficult material -- providing a searchable, semester-scale record of teaching that supports course reflection, reminders, and improvement. All components, including speech-to-text transcription, structured content extraction, and interactive query answering, run entirely on locally controlled hardware using open-weight models (Whisper large-v3, Llama~3.1 8B) with no dependence on cloud APIs, ensuring predictable costs, full data privacy, and reproducibility independent of third-party services. We describe the design, implementation, and practical failure modes encountered when deploying 7--8 billion parameter models for structured extraction over long lecture transcripts, including context truncation, bimodal output distributions, and schema drift, along with the mitigations that resolved them.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 27 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

12 of 27 references.

References · 12

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  3. 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
  4. 2024Large Language Models for Education: A Survey and Outlookcited by 185
  5. 2023Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Reviewcited by 83
  6. 2023Computing Education in the Era of Generative AIcited by 50
  7. 2023Assigning AI: Seven Approaches for Students, with Promptscited by 16
  8. 2023Harnessing LLMs in Curricular Design: Using GPT-4 to Support Authoring of Learning Objectivescited by 16
  9. 2025Using Large Language Models for Solving Thermodynamic Problemscited by 4
  10. 2024How critically can an AI think? A framework for evaluating the quality of thinking of generative artificial intelligencecited by 3
  11. 2025Small Models, Big Support: A Local LLM Framework for Educator-Centric Content Creation and Assessment with RAG and CAGcited by 3
  12. 2025From Canonical to Complex: Benchmarking LLM Capabilities in Undergraduate Thermodynamicscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Large Language Models for Education: ChemTAsk -- An Open-Source Paradigm for Automated Q&A in the Graduate Classroom
  2. 2026ARIA: Adaptive Retrieval Intelligence Assistant -- A Multimodal RAG Framework for Domain-Specific Engineering Education
  3. 2025Towards an Efficient, Customizable, and Accessible AI Tutor
  4. 2025From Slides to Chatbots: Enhancing Large Language Models with University Course Materials
  5. 2025AI University: An LLM-Powered Learning Assistant for Engineering---A Finite Element Method Case Study
  6. 2026On-Premises Multi-Course RAG Tutoring for Business Education: Hardware-Software Trade-offs in a Campus AI Tutor
  7. 2026ThermoQA: A Three-Tier Benchmark for Evaluating Thermodynamic Reasoning in Large Language Models
  8. 2024CourseAssist: Pedagogically Appropriate AI Tutor for Computer Science Education