mlsanityData to 14 Oct 2026

Does Graph Structure Earn Its Place in Microservice Root-Cause Analysis? A Controlled Study on RCAEval, and What the Benchmark Was Really Measuring

arXiv 2609.27069 ↗First posted 22 Sep 2026cs.SE cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph neural networks dominate recent work on microservice root-cause analysis, yet recent results question whether the graph contributes. Those results compare whole pipelines, so when a flat model wins one cannot tell whether structure is useless or redundant. We run the comparison they imply on RCAEval: three learned arms with identical features, optimiser, validation split, early-stopping rule and scoring head, in which a single term separates the graph arms. Across two RCAEval benchmarks, two topology sources and four regimes we find no reliable graph-specific effect: in-distribution the graph model leads the conventional flat model by 0.003 Avg@5 (p = 0.844, n = 6 disjoint folds). Auditing the pipeline surfaced two benchmark properties that condition any result on it. RCAEval injects faults into only five services per system while exposing 12 to 70 in telemetry, and the headline metric is Avg@5: a ranker reading no telemetry at all places the true culprit in the top five on 99.7 percent of held-out incidents, scoring Avg@5 0.488. That prior, not the uniform-random 0.137, is the honest in-distribution floor, and it collapses to 0.192 across systems. The second property is a non-uniform column schema that silently zeroes telemetry for most RE1 cases. We reproduce a published baseline, BARO, RCAEval's own reference implementation; on the one system with a clean schema it reaches similar aggregate accuracy to our heuristic, within 0.004, under a different scoring rule. The audit motivated a new model. PSC-GRCA separates a candidate score into a system prior, telemetry evidence and a centred graph residual, and reaches mean Avg@5 0.915 against 0.864 for the flat baseline, while its ablations locate most of the gain in the prior term rather than the graph. We close with a twelve-item checklist for graph-versus-flat ablation studies, distilled from sixty-two recorded defects.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 22 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

11 of 22 references.

References · 11

  1. 2021Deep Reinforcement Learning at the Edge of the Statistical Precipicecited by 807
  2. 2017Deep Reinforcement Learning that Matterscited by 754
  3. 2021Accounting for Variance in Machine Learning Benchmarkscited by 201
  4. 2024RCAEval: A Benchmark for Root Cause Analysis of Microservice Systems with Telemetry Datacited by 29
  5. 2024BARO: Robust Root Cause Analysis for Microservices via Multivariate Bayesian Online Change Point Detectioncited by 22
  6. 2023Eadro: An End-to-End Troubleshooting Framework for Microservices on Multi-source Datacited by 21
  7. 2024LEMMA-RCA: A Large Multi-modal Multi-domain Dataset for Root Cause Analysiscited by 9
  8. 2025Rethinking the Evaluation of Microservice RCA with a Fault Propagation-Aware Benchmarkcited by 6
  9. 2026Graph-Free Root Cause Analysiscited by 4
  10. 2024CHASE: A Causal Hypergraph based Framework for Root Cause Analysis in Multimodal Microservice Systemscited by 2
  11. 2025Are GNNs Actually Effective for Multimodal Fault Diagnosis in Microservice Systems?cited by 1

Built on by

Not cited yet.