Enhancing Software Development with Context-Aware Conversational Agents: A User Study on Developer Interactions with Chatbots
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Software development is a cognitively intensive process requiring multitasking, adherence to evolving workflows, and continuous learning. With the rise of large language model (LLM)-based tools, such as conversational agents (CAs), there is growing interest in supporting developers through natural language interaction. However, little is known about the specific features developers seek in these systems. We conducted a user study with 29 developers using a prototype text-based chatbot to investigate preferred functionalities. Our findings reveal strong interest in task automation, version control support, and contextual adaptability, especially the need to tailor assistance for both novice and experienced users. We highlight the importance of deep contextual understanding, historical interaction awareness, and personalized support in CA design. This study contributes to the development of context-aware chatbots that enhance productivity and satisfaction, and it outlines opportunities for future research on human-AI collaboration in software engineering.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 3 of its 43 references that are in the map. First posted on arXiv 13 May 2025.
Builds on
3 of 43 references.
References · 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Motivations, Challenges, Best Practices, and Benefits for Bots and Conversational Agents in Software Engineering: A Multivocal Literature Review
- 2023ChatDev: Communicative Agents for Software Development
- 2026Software as Content: Dynamic Applications as the Human-Agent Interaction Layer ↗
- 2025Generative AI and the Transformation of Software Development Practices
- 2025Context Engineering for Multi-Agent LLM Code Assistants Using Elicit, NotebookLM, ChatGPT, and Claude Code
- 2025From Correctness to Collaboration: Toward a Human-Centered Framework for Evaluating AI Agent Behavior in Software Engineering
- 2026From Human Interfaces to Agent Interfaces: Rethinking Software Design in the Age of AI-Native Systems
- 2023DevBots can co-design APIs