# LogSage: An LLM-Based Framework for CI/CD Failure Detection and Remediation with Industrial Validation

arXiv: https://arxiv.org/abs/2506.03691 · HTML: https://mlsanity.com/paper/2506.03691/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Jun 2025.

## Built on by (most cited first, 6 of 6)

- [Continuous Benchmark Generation for Evaluating Enterprise-scale LLM Agents](https://mlsanity.com/paper/2511.10049/) (2025)
- [NeSy-Edge: Neuro-Symbolic Trustworthy Self-Healing in the Computing Continuum](https://mlsanity.com/paper/2603.21145/) (2026)
- [LLM-Augmented Release Intelligence: Automated Change Summarization and Impact Analysis in Cloud-Native CI/CD Pipelines](https://mlsanity.com/paper/2603.14619/) (2026)
- [From Assistance to Agency: Rethinking Autonomy and Control in CI/CD Pipelines](https://mlsanity.com/paper/2605.07062/) (2026)
- [Kozuchi Agent: A Language-Agnostic Open-Weight Agent for Software Repair](https://mlsanity.com/paper/2608.15579/) (2026)
- [RETRACE: From Entangled Repair Histories to Reusable Experience for CI Repair](https://mlsanity.com/paper/2610.04658/) (2026)

## Abstract (arXiv)

Continuous Integration and Deployment (CI/CD) pipelines are critical to modern software engineering, yet diagnosing and resolving their failures remains complex and labor-intensive. We present LogSage, the first end-to-end LLM-powered framework for root cause analysis (RCA) and automated remediation of CI/CD failures. LogSage employs a token-efficient log preprocessing pipeline to filter noise and extract critical errors, then performs structured diagnostic prompting for accurate RCA. For solution generation, it leverages retrieval-augmented generation (RAG) to reuse historical fixes and invokes automation fixes via LLM tool-calling. On a newly curated benchmark of 367 GitHub CI/CD failures, LogSage achieves over 98% precision, near-perfect recall, and an F1 improvement of more than 38% points in the RCA stage, compared with recent LLM-based baselines. In a year-long industrial deployment at ByteDance, it processed over 1.07M executions, with end-to-end precision exceeding 80%. These results demonstrate that LogSage provides a scalable and practical solution for automating CI/CD failure management in real-world DevOps workflows.