LogSage: An LLM-Based Framework for CI/CD Failure Detection and Remediation with Industrial Validation
Not on the map. Why?
Abstract (arXiv)
Continuous Integration and Deployment (CI/CD) pipelines are critical to modern software engineering, yet diagnosing and resolving their failures remains complex and labor-intensive. We present LogSage, the first end-to-end LLM-powered framework for root cause analysis (RCA) and automated remediation of CI/CD failures. LogSage employs a token-efficient log preprocessing pipeline to filter noise and extract critical errors, then performs structured diagnostic prompting for accurate RCA. For solution generation, it leverages retrieval-augmented generation (RAG) to reuse historical fixes and invokes automation fixes via LLM tool-calling. On a newly curated benchmark of 367 GitHub CI/CD failures, LogSage achieves over 98% precision, near-perfect recall, and an F1 improvement of more than 38% points in the RCA stage, compared with recent LLM-based baselines. In a year-long industrial deployment at ByteDance, it processed over 1.07M executions, with end-to-end precision exceeding 80%. These results demonstrate that LogSage provides a scalable and practical solution for automating CI/CD failure management in real-world DevOps workflows.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 Jun 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025Continuous Benchmark Generation for Evaluating Enterprise-scale LLM Agentscited by 5
- 2026NeSy-Edge: Neuro-Symbolic Trustworthy Self-Healing in the Computing Continuumcited by 2
- 2026LLM-Augmented Release Intelligence: Automated Change Summarization and Impact Analysis in Cloud-Native CI/CD Pipelinescited by 0
- 2026From Assistance to Agency: Rethinking Autonomy and Control in CI/CD Pipelinescited by 0
- 2026Kozuchi Agent: A Language-Agnostic Open-Weight Agent for Software Repaircited by 0
- 2026RETRACE: From Entangled Repair Histories to Reusable Experience for CI Repaircited by 0
- 2026RETRACE: From Entangled Repair Histories to Reusable Experience for CI Repair3 Oct 2026
- 2026Kozuchi Agent: A Language-Agnostic Open-Weight Agent for Software Repair16 Aug 2026
- 2026From Assistance to Agency: Rethinking Autonomy and Control in CI/CD Pipelines8 May 2026
- 2026NeSy-Edge: Neuro-Symbolic Trustworthy Self-Healing in the Computing Continuum22 Mar 2026
- 2026LLM-Augmented Release Intelligence: Automated Change Summarization and Impact Analysis in Cloud-Native CI/CD Pipelines15 Mar 2026
- 2025Continuous Benchmark Generation for Evaluating Enterprise-scale LLM Agents13 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026LogSieve: Task-Aware CI Log Reduction for Sustainable LLM-Based Analysis
- 2026LogDx-CI: Benchmarking Log Reduction Tools for LLM Root-Cause Diagnosis
- 2026Calibration Without Comprehension: Diagnosing the Limits of Fine-Tuning LLMs for Vulnerability Detection in Systems Software
- 2026Leveraging Resolved Incident History for LLM-Assisted Software Bug Diagnosis ↗
- 2026TriCalRAG: A Three-Strategy, Retrieval-Augmented Benchmark for On-Premise LLM-Based Root Cause Analysis in AIOps
- 2026Ekka: Automated Diagnosis of Silent Errors in LLM Inference
- 2026Stalled, Biased, and Confused: Uncovering Reasoning Failures in LLMs for Cloud-Based Root Cause Analysis
- 2026Rethinking Automated Program Repair: The Impact of Bug Complexity, Fault Localization, and LLM Cost-efficiency