Holmes: Multimodal Agentic Diagnosis for Mixed-Language Mobile Crashes at Industrial Scale
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Diagnosing mobile crashes in ultra-large-scale industrial applications is a formidable challenge due to the sheer volume of code, the complexity of mixed-language environments, and the inability to reproduce failures locally. Traditional static analysis struggles with scalability, while existing LLM-based agents often rely on reproducible environments unavailable in post-mortem scenarios. We present Holmes, a multi-agent system that automates root cause analysis by synthesizing multimodal runtime signals--stack traces, logs, and thread states--to reconstruct failure contexts without reproduction. Holmes introduces a hierarchical Retrieve-Explore-Reason architecture that leverages low-level artifacts (e.g., registers, assembly) to bridge the semantic gap between open-source business logic and closed-source system frameworks. By dynamically compressing the search space using runtime clues, Holmes precisely navigates 70-million-line codebases to identify non-local defects. Evaluated on real-world crashes from WeChat, Holmes achieves 87.6% accuracy in function-level fault localization and reduces average investigation time by over 98% (to ~77 seconds), demonstrating its effectiveness in transforming labor-intensive debugging into an efficient verification workflow.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 6 of its 18 references that are in the map. First posted on arXiv 20 Jun 2026.
Builds on
6 of 18 references.
Closest ancestors · 2
Same direction, newest first
- 2025LocAgent: Graph-Guided LLM Agents for Code Localization12 Mar
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
Other references · 4
- 2023CodePlan: Repository-level Coding using LLMs and Planningcited by 140
- 2024RepoGraph: Enhancing AI Software Engineering with Repository-level Code Graphcited by 91
- 2025Walk the Talk: Is Your Log-based Software Reliability Maintenance System Really Reliable?cited by 10
- 2025Crash Report Enhancement with Large Language Models: An Empirical Studycited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026When Agentic Executions Fail: Detecting and Localizing Runtime Faults from Telemetry
- 2026SAFARI: Scaling Long Horizon Agentic Fault Attribution via Active Investigation
- 2026TelemetrySuffBench: Is Agent Telemetry Sufficient for Failure-Origin Diagnosis?
- 2026CUJBench: Benchmarking LLM-Agent on Cross-Modal Failure Diagnosis from Browser to Backend
- 2026TrajAudit: Automated Failure Diagnosis for Agentic Coding Systems
- 2026POIROT: Interrogating Agents for Failure Detection in Multi-Agent Systems
- 2026AgentFixer: From Failure Detection to Fix Recommendations in LLM Agentic Systems
- 2026AgentTether: Graph-Guided Diagnosis and Runtime Intervention for Reliable LLM Agent Operation