TOM-SWE: User Mental Modeling For Software Engineering Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Recent advances in coding agents have made them capable of planning, editing, running, and testing complex code bases. Despite their growing ability in coding tasks, these systems still struggle to infer and track user intent, especially when instructions are underspecified or context-dependent. To bridge this gap, we introduce ToM-SWE, a dual-agent architecture that pairs a primary software-engineering (SWE) agent with a lightweight theory-of-mind (ToM) partner agent dedicated to modeling the user's mental state. The ToM agent infers user goals, constraints, and preferences from instructions and interaction history, maintains a persistent memory of the user, and provides user-related suggestions to the SWE agent. In two software engineering benchmarks (ambiguous SWE-bench and stateful SWE-bench), ToM-SWE improves task success rates and user satisfaction. Notably, on the stateful SWE benchmark, a newly introduced evaluation that provides agents with a user simulator along with previous interaction histories, ToM-SWE achieves a substantially higher task success rate of 59.7% compared to 18.1% for OpenHands, a state-of-the-art SWE agent. Furthermore, in a three-week study with professional developers using ToM-SWE in their daily work, participants found it useful 86% of the time, underscoring the value of stateful user modeling for practical coding agents.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 37 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
19 of 37 references.
Closest ancestors · 4
Same direction, newest first
- 2025Ambig-SWE: Interactive Agents to Overcome Underspecificity in Software Engineering18 Feb
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
- 2024Executable Code Actions Elicit Better LLM Agents1 Feb
Other references · 15
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2024A Survey on Large Language Models for Code Generationcited by 658
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 367
- 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 171
- 2023Theory of Mind for Multi-Agent Collaboration via Large Language Modelscited by 135
- 2024Personalized Language Modeling from Personalized Human Feedbackcited by 132
- 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 124
- 2024MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentationcited by 119
- 2024DebugBench: Evaluating Debugging Capability of Large Language Modelscited by 76
- 2024User-LLM: Efficient LLM Contextualization with User Embeddingscited by 76
- 2025Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalizationcited by 45
Built on by
Citing papers per year: 2025: 2; 2026: 11.
13 papers.
Sort:
By area:
- 2026Mind the Sim2Real Gap in User Simulation for Agentic Taskscited by 54
- 2025Training Proactive and Personalized LLM Agentscited by 46
- 2026CooperBench: Why Coding Agents Cannot be Your Teammates Yetcited by 23
- 2026LLMs Get Lost in Evolving User Intentcited by 10
- 2026ThoughtTrace: Understanding User Thoughts in Real-World LLM Interactionscited by 7
- 2025Agentic Software Issue Resolution with Large Language Models: A Surveycited by 6
- 2026One Frozen Simulator Is Not Enough: Simulator Collapse in Multi-Agent RLcited by 6
- 2026Beyond Words: Evaluating and Bridging Epistemic Divergence in User-Agent Interaction via Theory of Mindcited by 2
- 2026Do Personalized Skills Help Coding Agents? An Empirical Study of Developer Interaction Historiescited by 1
- 2026Theory of Code Space: Do Code Agents Understand Software Architecture?cited by 0
- 2026SWE-Journey: Towards More Realistic Evaluation of Coding Assistants through Long-Horizon, Multi-Turn Interactioncited by 0
- 2026Collaborative Theory of Mind: Learning to Self-Revise by Anticipating User Responsescited by 0
- 2026Don't Guess, Just Ask: Evaluating Interactive Requirement Clarification for Repository-Level Software Development9 Oct 2026
- 2026Collaborative Theory of Mind: Learning to Self-Revise by Anticipating User Responses9 Oct 2026
- 2026SWE-Journey: Towards More Realistic Evaluation of Coding Assistants through Long-Horizon, Multi-Turn Interaction8 Oct 2026
- 2026One Frozen Simulator Is Not Enough: Simulator Collapse in Multi-Agent RL12 Aug 2026
- 2026Do Personalized Skills Help Coding Agents? An Empirical Study of Developer Interaction Histories10 Aug 2026
- 2026LLMs Get Lost in Evolving User Intent22 Jul 2026
- 2026ThoughtTrace: Understanding User Thoughts in Real-World LLM Interactions19 May 2026
- 2026Mind the Sim2Real Gap in User Simulation for Agentic Tasks11 Mar 2026
- 2026Theory of Code Space: Do Code Agents Understand Software Architecture?28 Feb 2026
- 2026Beyond Words: Evaluating and Bridging Epistemic Divergence in User-Agent Interaction via Theory of Mind14 Feb 2026
- 2026CooperBench: Why Coding Agents Cannot be Your Teammates Yet19 Jan 2026
- 2025Agentic Software Issue Resolution with Large Language Models: A Survey24 Dec 2025
1 more
- 2025Training Proactive and Personalized LLM Agents4 Nov 2025
- 2026Mind the Sim2Real Gap in User Simulation for Agentic Taskscited by 54
- 2025Training Proactive and Personalized LLM Agentscited by 46
- 2026CooperBench: Why Coding Agents Cannot be Your Teammates Yetcited by 23
- 2025Agentic Software Issue Resolution with Large Language Models: A Surveycited by 6
- 2026One Frozen Simulator Is Not Enough: Simulator Collapse in Multi-Agent RLcited by 6
- 2026Beyond Words: Evaluating and Bridging Epistemic Divergence in User-Agent Interaction via Theory of Mindcited by 2
- 2026Do Personalized Skills Help Coding Agents? An Empirical Study of Developer Interaction Historiescited by 1
- 2026Theory of Code Space: Do Code Agents Understand Software Architecture?cited by 0
- 2026SWE-Journey: Towards More Realistic Evaluation of Coding Assistants through Long-Horizon, Multi-Turn Interactioncited by 0
- 2026SWE-Journey: Towards More Realistic Evaluation of Coding Assistants through Long-Horizon, Multi-Turn Interaction8 Oct 2026
- 2026One Frozen Simulator Is Not Enough: Simulator Collapse in Multi-Agent RL12 Aug 2026
- 2026Do Personalized Skills Help Coding Agents? An Empirical Study of Developer Interaction Histories10 Aug 2026
- 2026Mind the Sim2Real Gap in User Simulation for Agentic Tasks11 Mar 2026
- 2026Theory of Code Space: Do Code Agents Understand Software Architecture?28 Feb 2026
- 2026Beyond Words: Evaluating and Bridging Epistemic Divergence in User-Agent Interaction via Theory of Mind14 Feb 2026
- 2026CooperBench: Why Coding Agents Cannot be Your Teammates Yet19 Jan 2026
- 2025Agentic Software Issue Resolution with Large Language Models: A Survey24 Dec 2025
- 2025Training Proactive and Personalized LLM Agents4 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026SWE-INTERACT: Reimagining SWE Benchmarks as User-Driven Long-Horizon Coding Sessions
- 2026SWE-Together: Evaluating Coding Agents in Interactive User Sessions
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Training
- 2026SWE-Touch: Benchmarking Coding Agents When Users Touch the Code
- 2026SWE-Skills-Bench: Do Agent Skills Actually Help in Real-World Software Engineering?
- 2025From Correctness to Collaboration: Toward a Human-Centered Framework for Evaluating AI Agent Behavior in Software Engineering
- 2026Dialogue SWE-Bench: A Benchmark for Dialogue-Driven Coding Agents
- 2026Humans are Missing from AI Coding Agent Research