What Should Data Science Education Do with Large Language Models?
Not on the map. Why?
Abstract (arXiv)
The rapid advances of large language models (LLMs), such as ChatGPT, are revolutionizing data science and statistics. These state-of-the-art tools can streamline complex processes. As a result, it reshapes the role of data scientists. We argue that LLMs are transforming the responsibilities of data scientists, shifting their focus from hands-on coding, data-wrangling and conducting standard analyses to assessing and managing analyses performed by these automated AIs. This evolution of roles is reminiscent of the transition from a software engineer to a product manager. We illustrate this transition with concrete data science case studies using LLMs in this paper. These developments necessitate a meaningful evolution in data science education. Pedagogy must now place greater emphasis on cultivating diverse skillsets among students, such as LLM-informed creativity, critical thinking, AI-guided programming. LLMs can also play a significant role in the classroom as interactive teaching and learning tools, contributing to personalized education. This paper discusses the opportunities, resources and open challenges for each of these directions. As with any transformative technology, integrating LLMs into education calls for careful consideration. While LLMs can perform repetitive tasks efficiently, it's crucial to remember that their role is to supplement human intelligence and creativity, not to replace it. Therefore, the new era of data science education should balance the benefits of LLMs while fostering complementary human expertise and innovations. In conclusion, the rise of LLMs heralds a transformative period for data science and its education. This paper seeks to shed light on the emerging trends, potential opportunities, and challenges accompanying this paradigm shift, hoping to spark further discourse and investigation into this exciting, uncharted territory.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 22 of its 36 references that are in the map. First posted on arXiv 6 Jul 2023.
Builds on
22 of 36 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 376
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2019Identifying and Reducing Gender Bias in Word-Level Language Modelscited by 214
10 more
- 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
- 2023GPT detectors are biased against non-native English writerscited by 175
- 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Modelscited by 174
- 2023Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Modelscited by 144
- 2023On Provable Copyright Protection for Generative Modelscited by 97
- 2023Is GPT-4 a Good Data Analyst?cited by 69
- 2023Boosting Theory-of-Mind Performance in Large Language Models via Promptingcited by 64
- 2023Mind meets machine: Unravelling GPT-4's cognitive psychologycited by 31
- 2020Data Science: A Comprehensive Overviewcited by 6
- 2016A Guide to Teaching Data Sciencecited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 8; 2025: 3.
13 papers.
Sort:
By area:
- 2024LAMBDA: A Large Model Based Data Agentcited by 30
- 2024A Survey on Large Language Model-based Agents for Statistics and Data Sciencecited by 22
- 2023User Modeling in the Era of Large Language Models: Current Research and Future Directionscited by 18
- 2024A Law of Next-Token Prediction in Large Language Modelscited by 15
- 2024Large Language Models in Computer Science Education: A Systematic Literature Reviewcited by 12
- 2024FOKE: A Personalized and Explainable Education Framework Integrating Foundation Models, Knowledge Graphs, and Prompt Engineeringcited by 6
- 2023Co-audit: tools to help humans double-check AI-generated contentcited by 5
- 2025Do Large Language Models (Really) Need Statistical Foundations?cited by 5
- 2024An Eye for an AI: Evaluating GPT-4o's Visual Perception Skills and Geometric Reasoning Skills Using Computer Graphics Questionscited by 2
- 2024Artificial intelligence and the transformation of higher education institutionscited by 1
- 2024Using ChatGPT for Data Science Analysescited by 0
- 2025Navigating Pitfalls: Evaluating LLMs in Machine Learning Programming Educationcited by 0
1 more
- 2025VDSAgents: A PCS-Guided Multi-Agent System for Veridical Data Science Automation28 Oct 2025
- 2025Do Large Language Models (Really) Need Statistical Foundations?25 May 2025
- 2025Navigating Pitfalls: Evaluating LLMs in Machine Learning Programming Education23 May 2025
- 2024A Survey on Large Language Model-based Agents for Statistics and Data Science18 Dec 2024
- 2024An Eye for an AI: Evaluating GPT-4o's Visual Perception Skills and Geometric Reasoning Skills Using Computer Graphics Questions22 Oct 2024
- 2024Large Language Models in Computer Science Education: A Systematic Literature Review21 Oct 2024
- 2024A Law of Next-Token Prediction in Large Language Models24 Aug 2024
- 2024LAMBDA: A Large Model Based Data Agent24 Jul 2024
- 2024FOKE: A Personalized and Explainable Education Framework Integrating Foundation Models, Knowledge Graphs, and Prompt Engineering6 May 2024
- 2024Using ChatGPT for Data Science Analyses12 Apr 2024
- 2024Artificial intelligence and the transformation of higher education institutions13 Feb 2024
- 2023User Modeling in the Era of Large Language Models: Current Research and Future Directions11 Dec 2023
1 more
- 2023User Modeling in the Era of Large Language Models: Current Research and Future Directionscited by 18
- 2024A Law of Next-Token Prediction in Large Language Modelscited by 15
- 2024Large Language Models in Computer Science Education: A Systematic Literature Reviewcited by 12
- 2024FOKE: A Personalized and Explainable Education Framework Integrating Foundation Models, Knowledge Graphs, and Prompt Engineeringcited by 6
- 2023Co-audit: tools to help humans double-check AI-generated contentcited by 5
- 2025Do Large Language Models (Really) Need Statistical Foundations?cited by 5
- 2024Artificial intelligence and the transformation of higher education institutionscited by 1
- 2024Using ChatGPT for Data Science Analysescited by 0
- 2025Navigating Pitfalls: Evaluating LLMs in Machine Learning Programming Educationcited by 0
- 2025Do Large Language Models (Really) Need Statistical Foundations?25 May 2025
- 2025Navigating Pitfalls: Evaluating LLMs in Machine Learning Programming Education23 May 2025
- 2024Large Language Models in Computer Science Education: A Systematic Literature Review21 Oct 2024
- 2024A Law of Next-Token Prediction in Large Language Models24 Aug 2024
- 2024FOKE: A Personalized and Explainable Education Framework Integrating Foundation Models, Knowledge Graphs, and Prompt Engineering6 May 2024
- 2024Using ChatGPT for Data Science Analyses12 Apr 2024
- 2024Artificial intelligence and the transformation of higher education institutions13 Feb 2024
- 2023User Modeling in the Era of Large Language Models: Current Research and Future Directions11 Dec 2023
- 2023Co-audit: tools to help humans double-check AI-generated content2 Oct 2023