Performance of ChatGPT on the US Fundamentals of Engineering Exam: Comprehensive Assessment of Proficiency and Potential Implications for Professional Environmental Engineering Practice
Not on the map. Why?
Abstract (arXiv)
In recent years, advancements in artificial intelligence (AI) have led to the development of large language models like GPT-4, demonstrating potential applications in various fields, including education. This study investigates the feasibility and effectiveness of using ChatGPT, a GPT-4 based model, in achieving satisfactory performance on the Fundamentals of Engineering (FE) Environmental Exam. This study further shows a significant improvement in the model's accuracy when answering FE exam questions through noninvasive prompt modifications, substantiating the utility of prompt modification as a viable approach to enhance AI performance in educational contexts. Furthermore, the findings reflect remarkable improvements in mathematical capabilities across successive iterations of ChatGPT models, showcasing their potential in solving complex engineering problems. Our paper also explores future research directions, emphasizing the importance of addressing AI challenges in education, enhancing accessibility and inclusion for diverse student populations, and developing AI-resistant exam questions to maintain examination integrity. By evaluating the performance of ChatGPT in the context of the FE Environmental Exam, this study contributes valuable insights into the potential applications and limitations of large language models in educational settings. As AI continues to evolve, these findings offer a foundation for further research into the responsible and effective integration of AI models across various disciplines, ultimately optimizing the learning experience and improving student outcomes.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 5 of its 36 references that are in the map. First posted on arXiv 20 Apr 2023.
Builds on
5 of 36 references.
References · 5
- 2023ChatGPT Participates in a Computer Science Examcited by 19
- 2021Short-term Hourly Streamflow Prediction with Graph Convolutional GRU Networkscited by 12
- 2023Platform-Independent and Curriculum-Oriented Intelligent Assistant for Higher Educationcited by 12
- 2020Realistic River Image Synthesis using Deep Generative Adversarial Networkscited by 9
- 2021DEM Super-Resolution with EfficientNetV2cited by 5
Built on by
Citing papers per year: 2023: 9; 2024: 4; 2025: 2.
15 papers.
Sort:
- 2024The Effect of Sampling Temperature on Problem Solving in Large Language Modelscited by 170
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
- 2023Artificial Intelligence-Enabled Intelligent Assistant for Personalized and Adaptive Learning in Higher Educationcited by 17
- 2023An Interdisciplinary Outlook on Large Language Models for Scientific Researchcited by 15
- 2023Perception, performance, and detectability of conversational artificial intelligence across 32 university coursescited by 12
- 2023Integrating AI and Learning Analytics for Data-Driven Pedagogical Decisions and Personalized Interventions in Educationcited by 7
- 2024An Empirical Evaluation of Large Language Models on Consumer Health Questionscited by 6
- 2024Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Examcited by 4
- 2023Professional Certification Benchmark Dataset: The First 500 Jobs For Large Language Modelscited by 2
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Researchcited by 1
- 2025An Open-Source Dual-Loss Embedding Model for Semantic Retrieval in Higher Educationcited by 1
- 2025Evaluating AI-Powered Learning Assistants in Engineering Higher Education: Student Engagement, Ethical Challenges, and Policy Implicationscited by 1
3 more
- 2023ChatGPT & Mechanical Engineering: Examining performance on the FE Mechanical Engineering and Undergraduate Examscited by 0
- 2023Evaluating AI Vocational Skills Through Professional Testingcited by 0
- 2024Integrating Generative AI in Hackathons: Opportunities, Challenges, and Educational Implicationscited by 0
- 2025Evaluating AI-Powered Learning Assistants in Engineering Higher Education: Student Engagement, Ethical Challenges, and Policy Implications6 Jun 2025
- 2025An Open-Source Dual-Loss Embedding Model for Semantic Retrieval in Higher Education8 May 2025
- 2024An Empirical Evaluation of Large Language Models on Consumer Health Questions31 Dec 2024
- 2024Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Exam14 Jun 2024
- 2024The Effect of Sampling Temperature on Problem Solving in Large Language Models7 Feb 2024
- 2024Integrating Generative AI in Hackathons: Opportunities, Challenges, and Educational Implications30 Jan 2024
- 2023Evaluating AI Vocational Skills Through Professional Testing17 Dec 2023
- 2023Integrating AI and Learning Analytics for Data-Driven Pedagogical Decisions and Personalized Interventions in Education15 Dec 2023
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Research6 Dec 2023
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-413 Nov 2023
- 2023An Interdisciplinary Outlook on Large Language Models for Scientific Research3 Nov 2023
- 2023ChatGPT & Mechanical Engineering: Examining performance on the FE Mechanical Engineering and Undergraduate Exams26 Sep 2023
3 more
- 2023Artificial Intelligence-Enabled Intelligent Assistant for Personalized and Adaptive Learning in Higher Education19 Sep 2023
- 2023Perception, performance, and detectability of conversational artificial intelligence across 32 university courses7 May 2023
- 2023Professional Certification Benchmark Dataset: The First 500 Jobs For Large Language Models7 May 2023
- 2024The Effect of Sampling Temperature on Problem Solving in Large Language Modelscited by 170
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
- 2023Artificial Intelligence-Enabled Intelligent Assistant for Personalized and Adaptive Learning in Higher Educationcited by 17
- 2023An Interdisciplinary Outlook on Large Language Models for Scientific Researchcited by 15
- 2023Perception, performance, and detectability of conversational artificial intelligence across 32 university coursescited by 12
- 2023Integrating AI and Learning Analytics for Data-Driven Pedagogical Decisions and Personalized Interventions in Educationcited by 7
- 2024An Empirical Evaluation of Large Language Models on Consumer Health Questionscited by 6
- 2024Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Examcited by 4
- 2023Professional Certification Benchmark Dataset: The First 500 Jobs For Large Language Modelscited by 2
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Researchcited by 1
- 2025An Open-Source Dual-Loss Embedding Model for Semantic Retrieval in Higher Educationcited by 1
- 2025Evaluating AI-Powered Learning Assistants in Engineering Higher Education: Student Engagement, Ethical Challenges, and Policy Implicationscited by 1
12 most cited of 15 All 15 (JSON)
- 2025Evaluating AI-Powered Learning Assistants in Engineering Higher Education: Student Engagement, Ethical Challenges, and Policy Implications6 Jun 2025
- 2025An Open-Source Dual-Loss Embedding Model for Semantic Retrieval in Higher Education8 May 2025
- 2024An Empirical Evaluation of Large Language Models on Consumer Health Questions31 Dec 2024
- 2024Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Exam14 Jun 2024
- 2024The Effect of Sampling Temperature on Problem Solving in Large Language Models7 Feb 2024
- 2024Integrating Generative AI in Hackathons: Opportunities, Challenges, and Educational Implications30 Jan 2024
- 2023Evaluating AI Vocational Skills Through Professional Testing17 Dec 2023
- 2023Integrating AI and Learning Analytics for Data-Driven Pedagogical Decisions and Personalized Interventions in Education15 Dec 2023
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Research6 Dec 2023
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-413 Nov 2023
- 2023An Interdisciplinary Outlook on Large Language Models for Scientific Research3 Nov 2023
- 2023ChatGPT & Mechanical Engineering: Examining performance on the FE Mechanical Engineering and Undergraduate Exams26 Sep 2023
12 newest of 15 All 15 (JSON)