Supporting software engineering tasks with agentic AI: Demonstration on document retrieval and test scenario generation
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
The introduction of large language models ignited great retooling and rethinking of the software development models. The ensuing response of software engineering research yielded a massive body of tools and approaches. In this paper, we join the hassle by introducing agentic AI solutions for two tasks. First, we developed a solution for automatic test scenario generation from a detailed requirements description. This approach relies on specialized worker agents forming a star topology with the supervisor agent in the middle. We demonstrate its capabilities on a real-world example. Second, we developed an agentic AI solution for the document retrieval task in the context of software engineering documents. Our solution enables performing various use cases on a body of documents related to the development of a single software, including search, question answering, tracking changes, and large document summarization. In this case, each use case is handled by a dedicated LLM-based agent, which performs all subtasks related to the corresponding use case. We conclude by hinting at the future perspectives of our line of research.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 21 of its 39 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
21 of 39 references.
Closest ancestors · 1
Same direction, newest first
Other references · 20
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
- 2023Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agentscited by 356
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
- 2023Fine-Tuning LLaMA for Multi-Stage Text Retrievalcited by 271
- 2024CoIR: A Comprehensive Benchmark for Code Information Retrieval Modelscited by 59
- 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 37
- 2023Information Retrieval Meets Large Language Models: A Strategic Report from Chinese IR Communitycited by 29
- 2024FanOutQA: A Multi-Hop, Multi-Document Question Answering Benchmark for Large Language Modelscited by 29
- 2018Semantically Enhanced Software Traceability Using Deep Learning Techniquescited by 22
- 2024System for systematic literature review using multiple AI agents: Concept and an empirical evaluationcited by 13
- 2024Generating Test Scenarios from NL Requirements using Retrieval-Augmented LLMs: An Industrial Studycited by 9
- 2023Conceptual Framework for Autonomous Cognitive Entitiescited by 6
8 more
- 2025Automatic High-Level Test Case Generation using Large Language Modelscited by 5
- 2025A Survey of Long-Document Retrieval in the PLM and LLM Eracited by 5
- 2023Retrieval for Extremely Long Queries and Documents with RPRS: a Highly Efficient and Effective Transformer-based Re-Rankercited by 4
- 2024A Tool for Test Case Scenarios Generation Using Large Language Modelscited by 4
- 2025Scenario-Guided LLM-based Mobile App GUI Testingcited by 4
- 2021The Power of Selecting Key Blocks with Local Pre-ranking for Long Document Information Retrievalcited by 3
- 2025Dynamic Chunking and Selection for Reading Comprehension of Ultra-Long Context in Large Language Modelscited by 3
- 2025An Empirical study on LLM-based Log Retrieval for Software Engineering Metadata Managementcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Reproducible, Explainable, and Effective Evaluations of Agentic AI for Software Engineering
- 2025Agentic RAG for Software Testing with Hybrid Vector-Graph and Multi-Agent Orchestration
- 2025Agentic AI for Software: thoughts from Software Engineering community
- 2026Agentic AI in the Software Development Lifecycle: Architecture, Empirical Evidence, and the Reshaping of Software Engineering
- 2026LLM-Based Agentic Systems for Software Engineering: Challenges and Opportunities
- 2025Agentic Software Issue Resolution with Large Language Models: A Survey
- 2026Automated Summarization of Software Documents: An LLM-based Multi-Agent Approach
- 2025Guided Search Strategies in Non-Serializable Environments with Applications to Software Engineering Agents