Novice Developers' Perspectives on Adopting LLMs for Software Development: A Systematic Literature Review
Not on the map. Why?
Abstract (arXiv)
Following the rise of large language models (LLMs), many studies have emerged in recent years focusing on exploring the adoption of LLM-based tools for software development by novice developers: computer science/software engineering students and early-career industry developers with two years or less of professional experience. These studies have sought to understand the perspectives of novice developers on using these tools, a critical aspect of the successful adoption of LLMs in software engineering. To systematically collect and summarise these studies, we conducted a systematic literature review (SLR) following the guidelines by Kitchenham et al. on 80 primary studies published between April 2022 and June 2025 to answer four research questions (RQs). In answering RQ1, we categorised the study motivations and methodological approaches. In RQ2, we identified the software development tasks for which novice developers use LLMs. In RQ3, we categorised the advantages, challenges, and recommendations discussed in the studies. Finally, we discuss the study limitations and future research needs suggested in the primary studies in answering RQ4. Throughout the paper, we also indicate directions for future work and implications for software engineering researchers, educators, and developers. Our research artifacts are publicly available at https://github.com/Samuellucas97/SupplementaryInfoPackage-SLR.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 67 of its 234 references that are in the map. First posted on arXiv 10 Mar 2025.
Builds on
67 of 234 references.
References · 67
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
- 2023Using an LLM to Help With Code Understandingcited by 222
- 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 216
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 203
- 2022Do Users Write More Insecure Code with AI Assistants?cited by 186
- 2024Large Language Models for Education: A Survey and Outlookcited by 185
- 2023Software Testing with Large Language Models: Survey, Landscape, and Visioncited by 163
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2023Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMscited by 103
- 2022Programming Is Hard -- Or at Least It Used to Be: Educational Opportunities And Challenges of AI Code Generationcited by 97
38 more
- 2023The Programmer's Assistant: Conversational Interaction with a Large Language Model for Software Developmentcited by 95
- 2023Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programmingcited by 87
- 2023The Robots are Here: Navigating the Generative AI Revolution in Computing Educationcited by 85
- 2023Towards an Understanding of Large Language Models in Software Engineering Taskscited by 67
- 2023"It's Weird That it Knows What I Want": Usability and Interactions with Copilot for Novice Programmerscited by 62
- 2023A Survey on Large Language Models for Software Engineeringcited by 58
- 2024The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmerscited by 46
- 2024Using AI-Based Coding Assistants in Practice: State of Affairs, Perceptions, and Ways Forwardcited by 44
- 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinkingcited by 43
- 2025We're Different, We're the Same: Creative Homogeneity Across LLMscited by 41
- 2023Navigating the Complexity of Generative AI Adoption in Software Engineeringcited by 32
- 2025Be Friendly, Not Friends: How LLM Sycophancy Shapes User Trustcited by 32
- 2023How Knowledge Workers Think Generative AI Will (Not) Transform Their Industriescited by 29
- 2024An Empirical Study on Usage and Perceptions of LLMs in a Software Engineering Projectcited by 28
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chatcited by 23
- 2024The Effects of Generative AI on Computing Students' Help-Seeking Preferencescited by 22
- 2024Prompts Are Programs Too! Understanding How Developers Build Software Containing Promptscited by 19
- 2023Generative AI in Computing Education: Perspectives of Students and Instructorscited by 17
- 2024Efficient and Green Large Language Models for Software Engineering: Literature Review, Vision, and the Road Aheadcited by 17
- 2023Trust in Generative AI among students: An Exploratory Studycited by 16
- 2024Rocks Coding, Not Development--A Human-Centric, Experimental Evaluation of LLM-Supported SE Taskscited by 13
- 2024Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Toolscited by 13
- 2024Take It, Leave It, or Fix It: Measuring Productivity and Trust in Human-AI Collaborationcited by 12
- 2024How Novice Programmers Use and Experience ChatGPT when Solving Programming Exercises in an Introductory Coursecited by 11
- 2016Why We Refactor? Confessions of GitHub Contributorscited by 10
- 2023Exploring the Problems, their Causes and Solutions of AI Pair Programming: A Study on GitHub and Stack Overflowcited by 10
- 2024Ecosystem of Large Language Models for Codecited by 10
- 2023How Far Are We? The Triumphs and Trials of Generative AI in Learning Software Engineeringcited by 9
- 2024Insights from Social Shaping Theory: The Appropriation of Large Language Models in an Undergraduate Programming Coursecited by 9
- 2025How Do Programming Students Use Generative AI?cited by 9
- 2025Human and Machine: How Software Engineers Perceive and Engage with AI-Assisted Code Reviews Compared to Their Peerscited by 8
- 2025LLMs' Reshaping of People, Processes, Products, and Society in Software Development: A Comprehensive Exploration with Early Adopterscited by 8
- 2017Developer Prioritization in Bug Repositoriescited by 7
- 2023Model-driven Engineering for Machine Learning Components: A Systematic Literature Reviewcited by 7
- 2024Debugging with Open-Source Large Language Models: An Evaluationcited by 7
- 2024"ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Coursescited by 6
- 2018Towards a Theory of Software Development Expertisecited by 5
- 2023ChatGPT as a Software Development Bot: A Project-based Studycited by 5
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025Walking the Tightrope of LLMs for Software Development: A Practitioners' Perspectivecited by 2
- 2025Cataloguing Hugging Face Models to Software Engineering Activities: Automation and Findingscited by 1
- 2026From Junior to Senior: Allocating Agency and Navigating Professional Growth in Agentic AI-Mediated Software Engineeringcited by 1
- 2026From Junior to Senior: Allocating Agency and Navigating Professional Growth in Agentic AI-Mediated Software Engineering31 Jan 2026
- 2025Walking the Tightrope of LLMs for Software Development: A Practitioners' Perspective9 Nov 2025
- 2025Cataloguing Hugging Face Models to Software Engineering Activities: Automation and Findings3 Jun 2025