# Transformative Effects of ChatGPT on Modern Education: Emerging Era of AI Chatbots

arXiv: https://arxiv.org/abs/2306.03823 · HTML: https://mlsanity.com/paper/2306.03823/

## Key facts

- Cited by 18 papers in the map (data through 14 Oct 2026).
- Builds on 5 of its 39 references that are in the map.
- First posted on arXiv 25 May 2023.

## Builds on (most cited first, 5 of 5)

- [ChatGPT: The End of Online Exam Integrity?](https://mlsanity.com/paper/2212.09292/) (2022)
- [ChatGPT and Software Testing Education: Promises & Perils](https://mlsanity.com/paper/2302.03287/) (2023)
- [Mind meets machine: Unravelling GPT-4's cognitive psychology](https://mlsanity.com/paper/2303.11436/) (2023)
- [Institutionalising Ethics in AI through Broader Impact Requirements](https://mlsanity.com/paper/2106.11039/) (2021)
- [ChatGPT: Vision and Challenges](https://mlsanity.com/paper/2305.15323/) (2023)

## Built on by (most cited first, 18 of 18)

- [Cognitive Mirage: A Review of Hallucinations in Large Language Models](https://mlsanity.com/paper/2309.06794/) (2023)
- [How Novice Programmers Use and Experience ChatGPT when Solving Programming Exercises in an Introductory Course](https://mlsanity.com/paper/2407.20792/) (2024)
- [Analyzing Chat Protocols of Novice Programmers Solving Introductory Programming Tasks with ChatGPT](https://mlsanity.com/paper/2405.19132/) (2024)
- [BC4LLM: Trusted Artificial Intelligence When Blockchain Meets Large Language Models](https://mlsanity.com/paper/2310.06278/) (2023)
- [Insights into Classifying and Mitigating LLMs' Hallucinations](https://mlsanity.com/paper/2311.08117/) (2023)
- [The Impact of Artificial Intelligence on the Evolution of Digital Education: A Comparative Study of OpenAI Text Generation Tools including ChatGPT, Bing Chat, Bard, and Ernie](https://mlsanity.com/paper/2309.02029/) (2023)
- [STOP! Benchmarking Large Language Models with Sensitivity Testing on Offensive Progressions](https://mlsanity.com/paper/2409.13843/) (2024)
- [Artificial intelligence and the transformation of higher education institutions](https://mlsanity.com/paper/2402.08143/) (2024)
- [The Evolution of Learning: Assessing the Transformative Impact of Generative AI on Higher Education](https://mlsanity.com/paper/2404.10551/) (2024)
- [CyberBOT: Towards Reliable Cybersecurity Education via Ontology-Grounded Retrieval Augmented Generation](https://mlsanity.com/paper/2504.00389/) (2025)
- [Students' Feedback Requests and Interactions with the SCRIPT Chatbot: Do They Get What They Ask For?](https://mlsanity.com/paper/2507.17258/) (2025)
- [Plausibility as Failure: How LLMs and Humans Co-Construct Epistemic Error](https://mlsanity.com/paper/2512.16750/) (2025)
- [Applications, challenges and ethical issues of AI and ChatGPT in education](https://mlsanity.com/paper/2402.07907/) (2024)
- [Unipa-GPT: Large Language Models for university-oriented QA in Italian](https://mlsanity.com/paper/2407.14246/) (2024)
- [Dialogue You Can Trust: Human and AI Perspectives on Generated Conversations](https://mlsanity.com/paper/2409.01808/) (2024)
- [Talking to Data: Designing Smart Assistants for Humanities Databases](https://mlsanity.com/paper/2506.00986/) (2025)
- [Bridging MOOCs, Smart Teaching, and AI-Assisted Learning: A Unified Quantitative Model](https://mlsanity.com/paper/2507.14266/) (2025)
- [AI in data science education: experiences from the classroom](https://mlsanity.com/paper/2510.00793/) (2025)

## Abstract (arXiv)

ChatGPT, an AI-based chatbot, was released to provide coherent and useful replies based on analysis of large volumes of data. In this article, leading scientists, researchers and engineers discuss the transformative effects of ChatGPT on modern education. This research seeks to improve our knowledge of ChatGPT capabilities and its use in the education sector, identifying potential concerns and challenges. Our preliminary evaluation concludes that ChatGPT performed differently in each subject area including finance, coding and maths. While ChatGPT has the ability to help educators by creating instructional content, offering suggestions and acting as an online educator to learners by answering questions and promoting group work, there are clear drawbacks in its use, such as the possibility of producing inaccurate or false data and circumventing duplicate content (plagiarism) detectors where originality is essential. The often reported hallucinations within Generative AI in general, and also relevant for ChatGPT, can render its use of limited benefit where accuracy is essential. What ChatGPT lacks is a stochastic measure to help provide sincere and sensitive communication with its users. Academic regulations and evaluation practices used in educational institutions need to be updated, should ChatGPT be used as a tool in education. To address the transformative effects of ChatGPT on the learning environment, educating teachers and students alike about its capabilities and limitations will be crucial.
