mlsanityData to 14 Oct 2026

LLM Agents Can See Code Repositories

arXiv 2606.14061 ↗First posted 12 Jun 2026cs.SEcited by 3

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Coding agents powered by large language models have demonstrated strong performance on software engineering tasks. Yet most agents consume repositories almost entirely as text, which differs from how human developers use visual structure such as folder hierarchies and dependency relationships to orient themselves in large codebases. With multimodal large language models (MLLMs), it is an open question whether agents can effectively benefit from visual representations of repositories. This paper presents the first systematic empirical study of visual repository representations for LLM-based agents on repository-level issue resolution. We evaluate four recent multimodal models. Our results show that a strictly vision-only setup degrades accuracy and increases token cost, because agents lack sufficient symbolic detail and compensate with repeated visual queries. In contrast, integrating visual graphs of repository structure as a supplementary modality alongside standard text interfaces helps agents understand structure more efficiently: input token consumption decreases by up to 26% while issue-resolution accuracy is maintained or improved. Visualization is most useful during fault localization and when the agent autonomously controls exploration depth. These findings point to a practical hybrid text-and-vision design for next-generation coding agents.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 48 references that are in the map. First posted on arXiv 12 Jun 2026.

Builds on

29 of 48 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026SWE-Explore: Benchmarking How Coding Agents Explore Repositories5 Jun
  2. 2026Test vs Mutant: Adversarial LLM Agents for Robust Unit Test Generation8 Feb
  3. 2025SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolution31 Jul
  4. 2025LocAgent: Graph-Guided LLM Agents for Code Localization12 Mar
  5. 2025OrcaLoca: An LLM Agent Framework for Software Issue Localization1 Feb
  6. 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement26 Oct
  7. 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul

Other references · 22

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 567
  3. 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 203
  4. 2023mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understandingcited by 168
  5. 2024CodexGraph: Bridging Large Language Models and Code Repositories via Code Graph Databasescited by 65
  6. 2025SWE-Exp: Experience-Driven Software Issue Resolutioncited by 65
  7. 2024From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debuggingcited by 46
  8. 2025LongCodeZip: Compress Long Context for Code Language Modelscited by 39
  9. 2025SWE-QA: Can Language Models Answer Repository-level Code Questions?cited by 38
  10. 2025EXPEREPAIR: Dual-Memory Enhanced LLM-based Repository-Level Program Repaircited by 35
  11. 2025Pruning the Unsurprising: Efficient LLM Reasoning via First-Token Surprisalcited by 32
  12. 2024Between Lines of Code: Unraveling the Distinct Patterns of Machine and Human Programmerscited by 27
10 more
  1. 2025Issue Localization via LLM-Driven Iterative Code Graph Searchingcited by 22
  2. 2025Improving Code Localization with Repository Memorycited by 20
  3. 2026In Line with Context: Repository-Level Code Generation via Context Inliningcited by 18
  4. 2026Seeing is Coding: On the Effectiveness of Vision Language Models in Code Understandingcited by 13
  5. 2025Seeing is Fixing: Cross-Modal Reasoning with Multimodal LLMs for Visual Software Issue Fixingcited by 12
  6. 2024LLMs as Continuous Learners: Improving the Reproduction of Defective Code in Software Issuescited by 10
  7. 2025FlowMalTrans: Unsupervised Binary Code Translation for Malware Detection Using Flow-Adapter Architecturecited by 10
  8. 2025Self-Abstraction from Grounded Experience for Plan-Guided Policy Refinementcited by 9
  9. 2026Zero-Shot Vulnerability Detection in Low-Resource Smart Contracts Through Solidity-Only Trainingcited by 3
  10. 2026SVRepair: Structured Visual Reasoning for Automated Program Repaircited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026RepoAtlas: Guiding Coding Agents via Evolving Multimodal Repository Views
  2. 2026Can Coding Agents Solve Repository-Level Issues with Rendered Code? An Exploratory Study of Visual Representations
  3. 2025Illuminating LLM Coding Agents: Visual Analytics for Deeper Understanding and Enhancement
  4. 2025Prometheus: Towards Long-Horizon Codebase Navigation for Repository-Level Problem Solving
  5. 2026Beyond Textual Repository Exploration: Dual-Modal Structural Reasoning for Agentic Issue Resolution
  6. 2026SWE-Adept: An LLM-Based Agentic Framework for Deep Codebase Analysis and Structured Issue Resolution
  7. 2026FastContext: Training Efficient Repository Explorer for Coding Agents
  8. 2026Code2UML: Agentic LLMs with context engineering for scalable software visualization