mlsanityData to 7 Oct 2026

Enhancing Software Development with Context-Aware Conversational Agents: A User Study on Developer Interactions with Chatbots

arXiv 2505.08648 ↗First posted 13 May 2025cs.SE cs.HCcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Software development is a cognitively intensive process requiring multitasking, adherence to evolving workflows, and continuous learning. With the rise of large language model (LLM)-based tools, such as conversational agents (CAs), there is growing interest in supporting developers through natural language interaction. However, little is known about the specific features developers seek in these systems. We conducted a user study with 29 developers using a prototype text-based chatbot to investigate preferred functionalities. Our findings reveal strong interest in task automation, version control support, and contextual adaptability, especially the need to tailor assistance for both novice and experienced users. We highlight the importance of deep contextual understanding, historical interaction awareness, and personalized support in CA design. This study contributes to the development of context-aware chatbots that enhance productivity and satisfaction, and it outlines opportunities for future research on human-AI collaboration in software engineering.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 3 of its 43 references that are in the map. First posted on arXiv 13 May 2025.

Builds on

3 of 43 references.

References · 3

  1. 2022Parallel Context Windows for Large Language Modelscited by 81
  2. 2020A Comparison of Natural Language Understanding Platforms for Chatbots in Software Engineeringcited by 10
  3. 2018Software Engineers vs. Machine Learning Algorithms: An Empirical Study Assessing Performance and Reuse Taskscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Motivations, Challenges, Best Practices, and Benefits for Bots and Conversational Agents in Software Engineering: A Multivocal Literature Review
  2. 2023ChatDev: Communicative Agents for Software Development
  3. 2026Software as Content: Dynamic Applications as the Human-Agent Interaction Layer ↗
  4. 2025Generative AI and the Transformation of Software Development Practices
  5. 2025Context Engineering for Multi-Agent LLM Code Assistants Using Elicit, NotebookLM, ChatGPT, and Claude Code
  6. 2025From Correctness to Collaboration: Toward a Human-Centered Framework for Evaluating AI Agent Behavior in Software Engineering
  7. 2026From Human Interfaces to Agent Interfaces: Rethinking Software Design in the Age of AI-Native Systems
  8. 2023DevBots can co-design APIs