# AI University: An LLM-Powered Learning Assistant for Engineering---A Finite Element Method Case Study

arXiv: https://arxiv.org/abs/2504.08846 · HTML: https://mlsanity.com/paper/2504.08846/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation.
- Builds on 17 of its 68 references that are in the map.
- First posted on arXiv 11 Apr 2025.

## Placed in

- Retrieval-augmented generation / [Agentic RAG, agents and memory](https://mlsanity.com/rag/agentic-rag-agents-and-memory/)

## Builds on (most cited first, 17 of 17)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [The Llama 3 Herd of Models](https://mlsanity.com/paper/2407.21783/) (2024)
- [Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks](https://mlsanity.com/paper/2005.11401/) (2020)
- [Optuna: A Next-generation Hyperparameter Optimization Framework](https://mlsanity.com/paper/1907.10902/) (2019)
- [Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning](https://mlsanity.com/paper/2012.13255/) (2020)
- [DeepSeek LLM: Scaling Open-Source Language Models with Longtermism](https://mlsanity.com/paper/2401.02954/) (2024)
- [Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks](https://mlsanity.com/paper/2103.14749/) (2021)
- [Measuring the Intrinsic Dimension of Objective Landscapes](https://mlsanity.com/paper/1804.08838/) (2018)
- [Large Language Models for Education: A Survey and Outlook](https://mlsanity.com/paper/2403.18105/) (2024)
- [Simulating Classroom Education with LLM-Empowered Agents](https://mlsanity.com/paper/2406.19226/) (2024)
- [A Comprehensive AI Policy Education Framework for University Teaching and Learning](https://mlsanity.com/paper/2305.00280/) (2023)
- [Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiency](https://mlsanity.com/paper/2407.09519/) (2024)
- [AI-TA: Towards an Intelligent Question-Answer Teaching Assistant using Open-Source LLMs](https://mlsanity.com/paper/2311.02775/) (2023)
- [Language Models as Science Tutors](https://mlsanity.com/paper/2402.11111/) (2024)
- [Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course?](https://mlsanity.com/paper/2312.07343/) (2023)
- [Whose ChatGPT? Unveiling Real-World Educational Inequalities Introduced by Large Language Models](https://mlsanity.com/paper/2410.22282/) (2024)
- [LLMs in the Classroom: Outcomes and Perceptions of Questions Written with the Aid of AI](https://mlsanity.com/paper/2503.18995/) (2025)

## Built on by (most cited first, 1 of 1)

- [FEM-Bench: A Structured Scientific Reasoning Benchmark for Evaluating Code-Generating LLMs](https://mlsanity.com/paper/2512.20732/) (2025)

## Abstract (arXiv)

We introduce AI University (AI-U), a flexible framework for AI-driven course content delivery that adapts to a course's instructional style. AI-U combines a fine-tuned large language model (LLM) with retrieval-augmented generation (RAG) and a reasoning synthesis model to generate style-aligned responses from lecture videos, notes, and textbooks. Using a graduate-level finite-element-method (FEM) course as a case study, we present a pipeline to synthesize course-grounded training data, fine-tune an open-source LLM with Low-Rank Adaptation (LoRA), and apply RAG-based synthesis. Our evaluation---combining cosine similarity, LLM-based assessment, expert review, and user studies---shows improved alignment with course materials relative to the base model. We have also developed a prototype web application, available at https://my-ai-university.com, that enhances AI-generated responses with references to relevant sections of the course material and clickable links to time-stamped video lectures. Our expert model is found to be higher scoring by a quantitative measure on 86% of test cases. An LLM judge also preferred our expert model to its base model under both evaluation prompts. Human evaluation by advanced users showed a preference for our expert model approximately twice as often as for the base model. The FEM course instructor found our expert model to achieve better alignment with class-specific content than a recent closed-weight model when both were combined with the reasoning synthesis model. AI-U offers a practical approach to developing course-specific learning assistants using fine-tuned and retrieval-augmented LLMs. By presenting our framework in an FEM class---central to training PhD and master's students in engineering science---we offer a template with potential for extension across STEM fields.