AI University: An LLM-Powered Learning Assistant for Engineering---A Finite Element Method Case Study
On the map: Retrieval-augmented generation → Agentic RAG, agents and memory
Abstract (arXiv)
We introduce AI University (AI-U), a flexible framework for AI-driven course content delivery that adapts to a course's instructional style. AI-U combines a fine-tuned large language model (LLM) with retrieval-augmented generation (RAG) and a reasoning synthesis model to generate style-aligned responses from lecture videos, notes, and textbooks. Using a graduate-level finite-element-method (FEM) course as a case study, we present a pipeline to synthesize course-grounded training data, fine-tune an open-source LLM with Low-Rank Adaptation (LoRA), and apply RAG-based synthesis. Our evaluation---combining cosine similarity, LLM-based assessment, expert review, and user studies---shows improved alignment with course materials relative to the base model. We have also developed a prototype web application, available at https://my-ai-university.com, that enhances AI-generated responses with references to relevant sections of the course material and clickable links to time-stamped video lectures. Our expert model is found to be higher scoring by a quantitative measure on 86% of test cases. An LLM judge also preferred our expert model to its base model under both evaluation prompts. Human evaluation by advanced users showed a preference for our expert model approximately twice as often as for the base model. The FEM course instructor found our expert model to achieve better alignment with class-specific content than a recent closed-weight model when both were combined with the reasoning synthesis model. AI-U offers a practical approach to developing course-specific learning assistants using fine-tuned and retrieval-augmented LLMs. By presenting our framework in an FEM class---central to training PhD and master's students in engineering science---we offer a template with potential for extension across STEM fields.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 17 of its 68 references that are in the map. First posted on arXiv 11 Apr 2025.
Builds on
17 of 68 references.
References · 17
- 2017Attention Is All You Needcited by 60,361
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 642
- 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 395
- 2018Measuring the Intrinsic Dimension of Objective Landscapescited by 370
- 2024Large Language Models for Education: A Survey and Outlookcited by 188
- 2024Simulating Classroom Education with LLM-Empowered Agentscited by 127
- 2023A Comprehensive AI Policy Education Framework for University Teaching and Learningcited by 34
- 2024Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiencycited by 31
5 more
- 2023AI-TA: Towards an Intelligent Question-Answer Teaching Assistant using Open-Source LLMscited by 22
- 2024Language Models as Science Tutorscited by 17
- 2023Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course?cited by 6
- 2024Whose ChatGPT? Unveiling Real-World Educational Inequalities Introduced by Large Language Modelscited by 5
- 2025LLMs in the Classroom: Outcomes and Perceptions of Questions Written with the Aid of AIcited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026ARIA: Adaptive Retrieval Intelligence Assistant -- A Multimodal RAG Framework for Domain-Specific Engineering Education
- 2024Evaluating the Impact of Advanced LLM Techniques on AI-Lecture Tutors for a Robotics Course
- 2025From Slides to Chatbots: Enhancing Large Language Models with University Course Materials
- 2025From Struggle (06-2024) to Mastery (02-2025) LLMs Conquer Advanced Algorithm Exams and Pave the Way for Editorial Generation
- 2025Small Models, Big Support: A Local LLM Framework for Educator-Centric Content Creation and Assessment with RAG and CAG
- 2026Large Language Models in Teaching and Learning: Reflections on Implementing an AI Chatbot in Higher Education ↗
- 2025From Query to Explanation: Uni-RAG for Multi-Modal Retrieval-Augmented Learning in STEM
- 2026An AI Teaching Assistant for Motion Picture Engineering