mlsanityData to 7 Oct 2026

Conversational AI as a Coding Assistant: Understanding Programmers' Interactions with and Expectations from Large Language Models for Coding

arXiv 2503.16508 ↗First posted 14 Mar 2025cs.HC cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

Conversational AI interfaces powered by large language models (LLMs) are increasingly used as coding assistants. However, questions remain about how programmers interact with LLM-based conversational agents, the challenges they encounter, and the factors influencing adoption. This study investigates programmers' usage patterns, perceptions, and interaction strategies when engaging with LLM-driven coding assistants. Through a survey, participants reported both the benefits, such as efficiency and clarity of explanations, and the limitations, including inaccuracies, lack of contextual awareness, and concerns about over-reliance. Notably, some programmers actively avoid LLMs due to a preference for independent learning, distrust in AI-generated code, and ethical considerations. Based on our findings, we propose design guidelines for improving conversational coding assistants, emphasizing context retention, transparency, multimodal support, and adaptability to user preferences. These insights contribute to the broader understanding of how LLM-based conversational agents can be effectively integrated into software development workflows while addressing adoption barriers and enhancing usability.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 10 of its 42 references that are in the map. First posted on arXiv 14 Mar 2025.

Builds on

10 of 42 references.

References · 10

  1. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  2. 2023Using an LLM to Help With Code Understandingcited by 222
  3. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 216
  4. 2022Programming Is Hard -- Or at Least It Used to Be: Educational Opportunities And Challenges of AI Code Generationcited by 97
  5. 2023Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programmingcited by 87
  6. 2023A Survey on Large Language Models for Software Engineeringcited by 58
  7. 2024An Empirical Study on Usage and Perceptions of LLMs in a Software Engineering Projectcited by 28
  8. 2024Examining the Use and Impact of an AI Code Assistant on Developer Productivity and Experience in the Enterprisecited by 17
  9. 2024A Study on Developer Behaviors for Validating and Repairing LLM-Generated Code Using Eye Tracking and IDE Actionscited by 12
  10. 2024Understanding the Human-LLM Dynamic: A Literature Survey of LLM Use in Programming Taskscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 3.

11 papers.