mlsanityData to 14 Oct 2026

LogSage: An LLM-Based Framework for CI/CD Failure Detection and Remediation with Industrial Validation

arXiv 2506.03691 ↗First posted 4 Jun 2025cs.SEcited by 6

Not on the map. Why?

Abstract (arXiv)

Continuous Integration and Deployment (CI/CD) pipelines are critical to modern software engineering, yet diagnosing and resolving their failures remains complex and labor-intensive. We present LogSage, the first end-to-end LLM-powered framework for root cause analysis (RCA) and automated remediation of CI/CD failures. LogSage employs a token-efficient log preprocessing pipeline to filter noise and extract critical errors, then performs structured diagnostic prompting for accurate RCA. For solution generation, it leverages retrieval-augmented generation (RAG) to reuse historical fixes and invokes automation fixes via LLM tool-calling. On a newly curated benchmark of 367 GitHub CI/CD failures, LogSage achieves over 98% precision, near-perfect recall, and an F1 improvement of more than 38% points in the RCA stage, compared with recent LLM-based baselines. In a year-long industrial deployment at ByteDance, it processed over 1.07M executions, with end-to-end precision exceeding 80%. These results demonstrate that LogSage provides a scalable and practical solution for automating CI/CD failure management in real-world DevOps workflows.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 Jun 2025.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 5.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026LogSieve: Task-Aware CI Log Reduction for Sustainable LLM-Based Analysis
  2. 2026LogDx-CI: Benchmarking Log Reduction Tools for LLM Root-Cause Diagnosis
  3. 2026Calibration Without Comprehension: Diagnosing the Limits of Fine-Tuning LLMs for Vulnerability Detection in Systems Software
  4. 2026Leveraging Resolved Incident History for LLM-Assisted Software Bug Diagnosis ↗
  5. 2026TriCalRAG: A Three-Strategy, Retrieval-Augmented Benchmark for On-Premise LLM-Based Root Cause Analysis in AIOps
  6. 2026Ekka: Automated Diagnosis of Silent Errors in LLM Inference
  7. 2026Stalled, Biased, and Confused: Uncovering Reasoning Failures in LLMs for Cloud-Based Root Cause Analysis
  8. 2026Rethinking Automated Program Repair: The Impact of Bug Complexity, Fault Localization, and LLM Cost-efficiency