LEMMA-RCA: A Large Multi-modal Multi-domain Dataset for Root Cause Analysis
Not on the map. Why?
Abstract (arXiv)
Root cause analysis (RCA) is crucial for enhancing the reliability and performance of complex systems. However, progress in this field has been hindered by the lack of large-scale, open-source datasets tailored for RCA. To bridge this gap, we introduce LEMMA-RCA, a large dataset designed for diverse RCA tasks across multiple domains and modalities. LEMMA-RCA features various real-world fault scenarios from Information Technology (IT) and Operational Technology (OT) systems, including microservices, water distribution, and water treatment systems, with hundreds of system entities involved. We evaluate the performance of six baseline methods on LEMMA-RCA across various settings, including offline and online models, as well as single and multi-modal settings. Our study demonstrates the utility of LEMMA-RCA in facilitating fair evaluation and promoting the development of more robust RCA techniques. The dataset is publicly available at https://www.lemmarca.info, with archival metadata and access instructions deposited under DOI: https://doi.org/10.5281/zenodo.20516735.
Key facts. Cited by 9 papers in the map (data through 13 Oct 2026). Builds on 15 of its 44 references that are in the map. First posted on arXiv 8 Jun 2024.
Builds on
15 of 44 references.
References · 15
- 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 748
- 2021Graph Neural Network-Based Anomaly Detection in Multivariate Time Seriescited by 300
- 2020DYNOTEARS: Structure Learning from Time-Series Datacited by 199
- 2020On the Role of Sparsity and DAG Constraints for Learning Linear DAGscited by 189
- 2023Automatic Root Cause Analysis via Large Language Models for Cloud Incidentscited by 82
- 2023RCAgent: Cloud Root Cause Analysis by Autonomous Agents with Tool-Augmented Large Language Modelscited by 64
- 2024Exploring LLM-based Agents for Root Cause Analysiscited by 61
- 2022Causal Inference-Based Root Cause Analysis for Online Service Systems with Intervention Recognitioncited by 56
- 2021Anomaly Detection and Failure Root Cause Analysis in (Micro)Service-Based Cloud Applications: A Surveycited by 47
- 2024BARO: Robust Root Cause Analysis for Microservices via Multivariate Bayesian Online Change Point Detectioncited by 22
- 2022Constructing Large-Scale Real-World Benchmark Datasets for AIOpscited by 20
- 2024X-lifecycle Learning for Cloud Incident Management using LLMscited by 19
3 more
- 2024Face It Yourselves: An LLM-Based Two-Stage Strategy to Localize Configuration Errors via Logscited by 17
- 2023MM-DAG: Multi-task DAG Learning for Multi-modal Data -- with Application for Traffic Congestion Analysiscited by 13
- 2024Multi-modal Causal Structure Learning and Root Cause Analysiscited by 6
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 6.
9 papers.
- 2024Online Multi-modal Root Cause Identification in Microservice Systemscited by 1
- 2026Bridging Temporal and Textual Modalities: A Multimodal Framework for Automated Cloud Failure Root Cause Analysiscited by 1
- 2026Towards In-Depth Root Cause Localization for Microservices with Multi-Agent Recursion-of-Thoughtcited by 1
- 2026What a Pooled Leaderboard Does Not Say: Auditing the Scope and Provenance of Method Comparisons in Microservice RCA Benchmarkscited by 1
- 2024RIO-CPD: A Riemannian Geometric Method for Correlation-aware Online Change Point Detectioncited by 0
- 2025An Identifiable Cost-Aware Causal Decision-Making Framework Using Counterfactual Reasoningcited by 0
- 2026CAMO: An Agentic Framework for Automated Causal Discovery from Micro Behaviors to Macro Emergence in LLM Agent Simulationscited by 0
- 2026Does Graph Structure Earn Its Place in Microservice Root-Cause Analysis? A Controlled Study on RCAEval, and What the Benchmark Was Really Measuringcited by 0
- 2026Where Root Cause Analysis Fails: A Retrieval-Reranking Decompositioncited by 0
- 2026Where Root Cause Analysis Fails: A Retrieval-Reranking Decomposition29 Sep 2026
- 2026Does Graph Structure Earn Its Place in Microservice Root-Cause Analysis? A Controlled Study on RCAEval, and What the Benchmark Was Really Measuring22 Sep 2026
- 2026What a Pooled Leaderboard Does Not Say: Auditing the Scope and Provenance of Method Comparisons in Microservice RCA Benchmarks28 Jun 2026
- 2026Towards In-Depth Root Cause Localization for Microservices with Multi-Agent Recursion-of-Thought14 May 2026
- 2026CAMO: An Agentic Framework for Automated Causal Discovery from Micro Behaviors to Macro Emergence in LLM Agent Simulations16 Apr 2026
- 2026Bridging Temporal and Textual Modalities: A Multimodal Framework for Automated Cloud Failure Root Cause Analysis8 Jan 2026
- 2025An Identifiable Cost-Aware Causal Decision-Making Framework Using Counterfactual Reasoning13 May 2025
- 2024Online Multi-modal Root Cause Identification in Microservice Systems13 Oct 2024
- 2024RIO-CPD: A Riemannian Geometric Method for Correlation-aware Online Change Point Detection12 Jul 2024