Beyond Traditional Teaching: The Potential of Large Language Models and Chatbots in Graduate Engineering Education
Not on the map. Why?
Abstract (arXiv)
In the rapidly evolving landscape of education, digital technologies have repeatedly disrupted traditional pedagogical methods. This paper explores the latest of these disruptions: the potential integration of large language models (LLMs) and chatbots into graduate engineering education. We begin by tracing historical and technological disruptions to provide context and then introduce key terms such as machine learning and deep learning and the underlying mechanisms of recent advancements, namely attention/transformer models and graphics processing units. The heart of our investigation lies in the application of an LLM-based chatbot in a graduate fluid mechanics course. We developed a question bank from the course material and assessed the chatbot's ability to provide accurate, insightful responses. The results are encouraging, demonstrating not only the bot's ability to effectively answer complex questions but also the potential advantages of chatbot usage in the classroom, such as the promotion of self-paced learning, the provision of instantaneous feedback, and the reduction of instructors' workload. The study also examines the transformative effect of intelligent prompting on enhancing the chatbot's performance. Furthermore, we demonstrate how powerful plugins like Wolfram Alpha for mathematical problem-solving and code interpretation can significantly extend the chatbot's capabilities, transforming it into a comprehensive educational tool. While acknowledging the challenges and ethical implications surrounding the use of such AI models in education, we advocate for a balanced approach. The use of LLMs and chatbots in graduate education can be greatly beneficial but requires ongoing evaluation and adaptation to ensure ethical and efficient use.
Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Builds on 55 of its 206 references that are in the map. First posted on arXiv 9 Sep 2023.
Builds on
55 of 206 references.
References · 55
- 2017Attention Is All You Needcited by 60,106
- 2022Training language models to follow instructions with human feedbackcited by 15,856
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,221
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,317
- 2017On Calibration of Modern Neural Networkscited by 4,902
- 2017Deep reinforcement learning from human preferencescited by 3,871
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,181
- 2022Emergent Abilities of Large Language Modelscited by 2,499
- 2021Learning to Prompt for Vision-Language Modelscited by 2,276
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,229
38 more
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,052
- 2019Language Models as Knowledge Bases?cited by 1,931
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,709
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,404
- 2023PaLM 2 Technical Reportcited by 1,162
- 2021Ethical and social risks of harm from Language Modelscited by 964
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 798
- 2022Quantifying Memorization Across Neural Language Modelscited by 763
- 2020Aligning AI With Shared Human Valuescited by 717
- 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 626
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 616
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 605
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 515
- 2023Preference Ranking Optimization for Human Alignmentcited by 284
- 2023How is ChatGPT's behavior changing over time?cited by 268
- 2023MultiModal-GPT: A Vision and Language Model for Dialogue with Humanscited by 255
- 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 250
- 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 221
- 2023A Categorical Archive of ChatGPT Failurescited by 168
- 2017On the State of the Art of Evaluation in Neural Language Modelscited by 104
- 2018Language GANs Falling Shortcited by 97
- 2020Trading Off Diversity and Quality in Natural Language Generationcited by 94
- 2019Do Massively Pretrained Language Models Make Better Storytellers?cited by 90
- 2018From Eliza to XiaoIce: Challenges and Opportunities with Social Chatbotscited by 85
- 2016Reward Augmented Maximum Likelihood for Neural Structured Predictioncited by 81
- 2022Iteratively Prompt Pre-trained Language Models for Chain of Thoughtcited by 75
- 2023Eight Things to Know about Large Language Modelscited by 73
- 2022Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Modelscited by 70
- 2021HTLM: Hyper-Text Pre-Training and Prompting of Language Modelscited by 58
- 2021Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processingcited by 57
- 2016Reinforcement Learning through Asynchronous Advantage Actor-Critic on a GPUcited by 46
- 2023An Empirical Study on Information Extraction using Large Language Modelscited by 46
- 2023Will ChatGPT get you caught? Rethinking of Plagiarism Detectioncited by 41
- 2022FiDO: Fusion-in-Decoder optimized for stronger performance and faster inferencecited by 31
- 2019A Survey of Natural Language Generation Techniques with a Focus on Dialogue Systems - Past, Present and Future Directionscited by 26
- 2022A Literature Survey of Recent Advances in Chatbotscited by 26
- 2018Learning When to Concentrate or Divert Attention: Self-Adaptive Attention Temperature for Neural Machine Translationcited by 10
- 2020A Comparison of Natural Language Understanding Platforms for Chatbots in Software Engineeringcited by 10
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2024: 4.
4 papers.
- 2024Large Language Models for Manufacturingcited by 24
- 2024DiffusionAttacker: Diffusion-Driven Prompt Manipulation for LLM Jailbreakcited by 9
- 2024Adversarial Math Word Problem Generationcited by 6
- 2024Battling Botpoop using GenAI for Higher Education: A Study of a Retrieval Augmented Generation Chatbots Impact on Learningcited by 4
- 2024DiffusionAttacker: Diffusion-Driven Prompt Manipulation for LLM Jailbreak23 Dec 2024
- 2024Large Language Models for Manufacturing28 Oct 2024
- 2024Battling Botpoop using GenAI for Higher Education: A Study of a Retrieval Augmented Generation Chatbots Impact on Learning12 Jun 2024
- 2024Adversarial Math Word Problem Generation27 Feb 2024