mlsanityData to 14 Oct 2026

Interacting with AI Reasoning Models: Harnessing "Thoughts" for AI-Driven Software Engineering

arXiv 2503.00483 ↗First posted 1 Mar 2025cs.SE cs.AI cs.HCcited by 2

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Recent advances in AI reasoning models provide unprecedented transparency into their decision-making processes, transforming them from traditional black-box systems into models that articulate step-by-step chains of thought rather than producing opaque outputs. This shift has the potential to improve software quality, explainability, and trust in AI-augmented development. However, software engineers rarely have the time or cognitive bandwidth to analyze, verify, and interpret every AI-generated thought in detail. Without an effective interface, this transparency could become a burden rather than a benefit. In this paper, we propose a vision for structuring the interaction between AI reasoning models and software engineers to maximize trust, efficiency, and decision-making power. We argue that simply exposing AI's reasoning is not enough -- software engineers need tools and frameworks that selectively highlight critical insights, filter out noise, and facilitate rapid validation of key assumptions. To illustrate this challenge, we present motivating examples in which AI reasoning models state their assumptions when deciding which external library to use and produce divergent reasoning paths and recommendations about security vulnerabilities, highlighting the need for an interface that prioritizes actionable insights while managing uncertainty and resolving conflicts. We then outline a research roadmap for integrating automated summarization, assumption validation, and multi-model conflict resolution into software engineering workflows. Achieving this vision will unlock the full potential of AI reasoning models to enable software engineers to make faster, more informed decisions without being overwhelmed by unnecessary detail.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 8 of its 34 references that are in the map. First posted on arXiv 1 Mar 2025.

Builds on

8 of 34 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024OpenAI o1 System Card21 Dec

Other references · 7

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  2. 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 550
  3. 2023Mastering Symbolic Operations: Augmenting Language Models with Compiled Neural Networkscited by 12
  4. 2025Generative AI and Empirical Software Engineering: A Paradigm Shiftcited by 9
  5. 2023Towards CausalGPT: A Multi-Agent Approach for Faithful Knowledge Reasoning via Promoting Causal Consistency in LLMscited by 4
  6. 2024Trustworthy and Responsible AI for Human-Centric Autonomous Decision-Making Systemscited by 3
  7. 2024A Systematic Literature Review on Explainability for Machine/Deep Learning-based Software Engineering Researchcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Lost in Code Generation: Reimagining the Role of Software Models in AI-driven Software Engineering
  2. 2026Agentic Software: How AI Agents Are Restructuring the Software Paradigm
  3. 2025Understanding Software Engineering Agents: A Study of Thought-Action-Result Trajectories
  4. 2026Agentic AI in the Software Development Lifecycle: Architecture, Empirical Evidence, and the Reshaping of Software Engineering
  5. 2026Trustworthy AI Software Engineers
  6. 2026Towards Structured, State-Aware, and Execution-Grounded Reasoning for Software Engineering Agents
  7. 2025From Correctness to Collaboration: Toward a Human-Centered Framework for Evaluating AI Agent Behavior in Software Engineering
  8. 2026From Determinism to Delegation: AI-Native Software Engineering and the Evolution of the Agentic Engineer