The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Own
Not on the map. Why?
Abstract (arXiv)
This paper presents a comprehensive investigation into the capability of Large Language Models (LLMs) to successfully complete a semester-long undergraduate control systems course. Through evaluation of 115 course deliverables, we assess LLM performance using ChatGPT under a "minimal effort" protocol that simulates realistic student usage patterns. The investigation employs a rigorous testing methodology across multiple assessment formats, from auto-graded multiple choice questions to complex Python programming tasks and long-form analytical writing. Our analysis provides quantitative insights into AI's strengths and limitations in handling mathematical formulations, coding challenges, and theoretical concepts in control systems engineering. The LLM achieved a B-grade performance (82.24%), approaching but not exceeding the class average (84.99%), with strongest results in structured assignments and greatest limitations in open-ended projects. The findings inform discussions about course design adaptation in response to AI advancement, moving beyond simple prohibition towards thoughtful integration of these tools in engineering education. Additional materials including syllabus, examination papers, design projects, and example responses can be found at the project website: https://gradegpt.github.io.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 17 of its 21 references that are in the map. First posted on arXiv 23 Feb 2025.
Builds on
17 of 21 references.
References · 17
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
- 2023Testing of Detection Tools for AI-Generated Textcited by 90
- 2024LLM Circuit Analyses Are Consistent Across Training and Scalecited by 63
- 2024Capabilities of Large Language Models in Control Engineering: A Benchmark Study on GPT-4, Claude 3 Opus, and Gemini 1.0 Ultracited by 37
- 2024Can Large Language Models Automatically Score Proficiency of Written Essays?cited by 35
- 2024Large Language Models for Education: A Surveycited by 34
- 2023Detecting LLM-Generated Text in Computing Education: A Comparative Study for ChatGPT Casescited by 32
- 2024Evaluating the Effectiveness of LLMs in Introductory Computer Science Education: A Semester-Long Field Studycited by 26
- 2024CS1-LLM: Integrating LLMs into CS1 Instructioncited by 16
- 2024Assessing Large Language Models in Mechanical Engineering Education: A Study on Mechanics-Focused Conceptual Understandingcited by 15
- 2024Insights from Social Shaping Theory: The Appropriation of Large Language Models in an Undergraduate Programming Coursecited by 9
5 more
- 2023Waiting, Banning, and Embracing: An Empirical Analysis of Adapting Policies for Generative AI in Higher Educationcited by 7
- 2024An Exploratory Study on Upper-Level Computing Students' Use of Large Language Models as Tools in a Semester-Long Projectcited by 6
- 2024Evaluating Students' Open-ended Written Responses with LLMs: Using the RAG Framework for GPT-3.5, GPT-4, Claude-3, and Mistral-Largecited by 6
- 2024Survey on Plagiarism Detection in Large Language Models: The Impact of ChatGPT and Gemini on Academic Integritycited by 5
- 2023Examining the Influence of Varied Levels of Domain Knowledge Base Inclusion in GPT-based Intelligent Tutorscited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.