mlsanityData to 13 Oct 2026

Beyond Traditional Teaching: The Potential of Large Language Models and Chatbots in Graduate Engineering Education

arXiv 2309.13059 ↗First posted 9 Sep 2023cs.CY cs.AI cs.HCcited by 4

Not on the map. Why?

Abstract (arXiv)

In the rapidly evolving landscape of education, digital technologies have repeatedly disrupted traditional pedagogical methods. This paper explores the latest of these disruptions: the potential integration of large language models (LLMs) and chatbots into graduate engineering education. We begin by tracing historical and technological disruptions to provide context and then introduce key terms such as machine learning and deep learning and the underlying mechanisms of recent advancements, namely attention/transformer models and graphics processing units. The heart of our investigation lies in the application of an LLM-based chatbot in a graduate fluid mechanics course. We developed a question bank from the course material and assessed the chatbot's ability to provide accurate, insightful responses. The results are encouraging, demonstrating not only the bot's ability to effectively answer complex questions but also the potential advantages of chatbot usage in the classroom, such as the promotion of self-paced learning, the provision of instantaneous feedback, and the reduction of instructors' workload. The study also examines the transformative effect of intelligent prompting on enhancing the chatbot's performance. Furthermore, we demonstrate how powerful plugins like Wolfram Alpha for mathematical problem-solving and code interpretation can significantly extend the chatbot's capabilities, transforming it into a comprehensive educational tool. While acknowledging the challenges and ethical implications surrounding the use of such AI models in education, we advocate for a balanced approach. The use of LLMs and chatbots in graduate education can be greatly beneficial but requires ongoing evaluation and adaptation to ensure ethical and efficient use.

Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Builds on 55 of its 206 references that are in the map. First posted on arXiv 9 Sep 2023.

Builds on

55 of 206 references.

References · 55

  1. 2017Attention Is All You Needcited by 60,106
  2. 2022Training language models to follow instructions with human feedbackcited by 15,856
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,221
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
  6. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,317
  7. 2017On Calibration of Modern Neural Networkscited by 4,902
  8. 2017Deep reinforcement learning from human preferencescited by 3,871
  9. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,181
  10. 2022Emergent Abilities of Large Language Modelscited by 2,499
  11. 2021Learning to Prompt for Vision-Language Modelscited by 2,276
  12. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,229
38 more
  1. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,052
  2. 2019Language Models as Knowledge Bases?cited by 1,931
  3. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,709
  4. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,404
  5. 2023PaLM 2 Technical Reportcited by 1,162
  6. 2021Ethical and social risks of harm from Language Modelscited by 964
  7. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 798
  8. 2022Quantifying Memorization Across Neural Language Modelscited by 763
  9. 2020Aligning AI With Shared Human Valuescited by 717
  10. 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 626
  11. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 616
  12. 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 605
  13. 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 515
  14. 2023Preference Ranking Optimization for Human Alignmentcited by 284
  15. 2023How is ChatGPT's behavior changing over time?cited by 268
  16. 2023MultiModal-GPT: A Vision and Language Model for Dialogue with Humanscited by 255
  17. 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 250
  18. 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 221
  19. 2023A Categorical Archive of ChatGPT Failurescited by 168
  20. 2017On the State of the Art of Evaluation in Neural Language Modelscited by 104
  21. 2018Language GANs Falling Shortcited by 97
  22. 2020Trading Off Diversity and Quality in Natural Language Generationcited by 94
  23. 2019Do Massively Pretrained Language Models Make Better Storytellers?cited by 90
  24. 2018From Eliza to XiaoIce: Challenges and Opportunities with Social Chatbotscited by 85
  25. 2016Reward Augmented Maximum Likelihood for Neural Structured Predictioncited by 81
  26. 2022Iteratively Prompt Pre-trained Language Models for Chain of Thoughtcited by 75
  27. 2023Eight Things to Know about Large Language Modelscited by 73
  28. 2022Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Modelscited by 70
  29. 2021HTLM: Hyper-Text Pre-Training and Prompting of Language Modelscited by 58
  30. 2021Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processingcited by 57
  31. 2016Reinforcement Learning through Asynchronous Advantage Actor-Critic on a GPUcited by 46
  32. 2023An Empirical Study on Information Extraction using Large Language Modelscited by 46
  33. 2023Will ChatGPT get you caught? Rethinking of Plagiarism Detectioncited by 41
  34. 2022FiDO: Fusion-in-Decoder optimized for stronger performance and faster inferencecited by 31
  35. 2019A Survey of Natural Language Generation Techniques with a Focus on Dialogue Systems - Past, Present and Future Directionscited by 26
  36. 2022A Literature Survey of Recent Advances in Chatbotscited by 26
  37. 2018Learning When to Concentrate or Divert Attention: Self-Adaptive Attention Temperature for Neural Machine Translationcited by 10
  38. 2020A Comparison of Natural Language Understanding Platforms for Chatbots in Software Engineeringcited by 10

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 4.

4 papers.