Build AI Assistants using Large Language Models and Agents to Enhance the Engineering Education of Biomechanics
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
While large language models (LLMs) have demonstrated remarkable versatility across a wide range of general tasks, their effectiveness often diminishes in domain-specific applications due to inherent knowledge gaps. Moreover, their performance typically declines when addressing complex problems that require multi-step reasoning and analysis. In response to these challenges, we propose leveraging both LLMs and AI agents to develop education assistants aimed at enhancing undergraduate learning in biomechanics courses that focus on analyzing the force and moment in the musculoskeletal system of the human body. To achieve our goal, we construct a dual-module framework to enhance LLM performance in biomechanics educational tasks: 1) we apply Retrieval-Augmented Generation (RAG) to improve the specificity and logical consistency of LLM's responses to the conceptual true/false questions; 2) we build a Multi-Agent System (MAS) to solve calculation-oriented problems involving multi-step reasoning and code execution. Specifically, we evaluate the performance of several LLMs, i.e., Qwen-1.0-32B, Qwen-2.5-32B, and Llama-70B, on a biomechanics dataset comprising 100 true/false conceptual questions and problems requiring equation derivation and calculation. Our results demonstrate that RAG significantly enhances the performance and stability of LLMs in answering conceptual questions, surpassing those of vanilla models. On the other hand, the MAS constructed using multiple LLMs demonstrates its ability to perform multi-step reasoning, derive equations, execute code, and generate explainable solutions for tasks that require calculation. These findings demonstrate the potential of applying RAG and MAS to enhance LLM performance for specialized courses in engineering curricula, providing a promising direction for developing intelligent tutoring in engineering education.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 38 of its 67 references that are in the map. First posted on arXiv 19 Nov 2025.
Builds on
38 of 67 references.
References · 38
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
- 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 466
- 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 408
- 2024The Faiss librarycited by 370
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
- 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 326
- 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266
26 more
- 2024Evaluation of Retrieval-Augmented Generation: A Surveycited by 146
- 2024Multi-Step Reasoning with Large Language Models, a Surveycited by 140
- 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospectscited by 130
- 2023Almanac: Retrieval-Augmented Language Models for Clinical Medicinecited by 122
- 2023Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Healthcited by 118
- 2024Evaluating Retrieval Quality in Retrieval-Augmented Generationcited by 90
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 85
- 2024Searching for Best Practices in Retrieval-Augmented Generationcited by 83
- 2024CBR-RAG: Case-Based Reasoning for Retrieval Augmented Generation in LLMs for Legal Question Answeringcited by 70
- 2024Retrieval-Augmented Generation for Natural Language Processing: A Surveycited by 70
- 2024Improving Retrieval-Augmented Generation in Medicine with Iterative Follow-up Questionscited by 54
- 2023Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Modelscited by 35
- 2024Improving Medical Reasoning through Retrieval and Self-Reflection with Retrieval-Augmented Large Language Modelscited by 34
- 2023MKRAG: Medical Knowledge Retrieval Augmented Generation for Medical Question Answeringcited by 23
- 2024Retrieval Augmented Generation for Domain-specific Question Answeringcited by 22
- 2024CLERC: A Dataset for Legal Case Retrieval and Retrieval-Augmented Analysis Generationcited by 18
- 2024Modality-Aware Integration with Large Language Models for Knowledge-based Visual Question Answeringcited by 15
- 2024Prompting Large Language Models with Knowledge Graphs for Question Answering Involving Long-tail Factscited by 14
- 2025SearchRAG: Can Search Engines Be Helpful for LLM-based Medical Question Answering?cited by 9
- 2024Knowledge Acquisition Disentanglement for Knowledge-based Visual Question Answering with Large Language Modelscited by 8
- 2024Transforming Teachers' Roles and Agencies in the Era of Generative AI: Perceptions, Acceptance, Knowledge, and Practicescited by 8
- 2025Bridging Legal Knowledge and AI: Retrieval-Augmented Generation with Vector Stores, Knowledge Graphs, and Hierarchical Non-negative Matrix Factorizationcited by 8
- 2025LawPal : A Retrieval Augmented Generation Based System for Enhanced Legal Accessibility in Indiacited by 6
- 2024Realizing Visual Question Answering for Education: GPT-4V as a Multimodal AIcited by 5
- 2024Retrieval-Augmented Generation for Generative Artificial Intelligence in Medicinecited by 3
- 2024Cost-efficient Knowledge-based Question Answering with Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Towards an Efficient, Customizable, and Accessible AI Tutor
- 2024Evaluating the Impact of Advanced LLM Techniques on AI-Lecture Tutors for a Robotics Course
- 2026BoT-Feedback: Grounding Multimodal Reasoning in Biomechanical Evidence for Explainable Human Action Feedback
- 2026Large Language Models in Teaching and Learning: Reflections on Implementing an AI Chatbot in Higher Education ↗
- 2026BiomechAgent: AI-Assisted Biomechanical Analysis Through Code-Generating Agents
- 2025LLM Agents for Education: Advances and Applications
- 2025A Theory of Adaptive Scaffolding for LLM-Based Pedagogical Agents
- 2026BioEVAL: A global, multi-institutional benchmark of large language and multimodal models for bioengineering