Picid: A Modular Evaluation Infrastructure for Reproducible PHM Across Tasks and Domains
Not on the map. Why?
Abstract (arXiv)
Progress in Prognostics and Health Management (PHM) is hindered by the lack of standardized and reusable evaluation practices across tasks, datasets, and application domains. Reported results are often difficult to reproduce and compare, as key protocol choices, such as data splits, preprocessing, label alignment, temporal windowing, and metrics, are often implicit or implemented ad hoc. We introduce picid, a modular evaluation infrastructure that formalizes the PHM evaluation pipeline as an explicit, executable, and reproducible protocol. Through well-defined abstractions, picid enforces deterministic, leakage-safe dataset construction while remaining flexible across diverse PHM settings. The framework supports fault detection, diagnostics, and prognostics through a unified interface and can be extended to new datasets and model classes without violating protocol invariants. By standardizing data contracts and evaluation boundaries, picid also enables fair cross-task comparisons across diagnostics (classification) and prognostics (regression), allowing identical model families to be evaluated consistently across heterogeneous settings. We demonstrate picid through an empirical evaluation of thirteen models on twelve datasets spanning batteries, bearings, turbofan engines, hydraulics, filtration systems, and buildings. This work establishes a reusable foundation for standardized, fair and reproducible evaluation in PHM.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 4 of its 60 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
4 of 60 references.
References · 4
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 197
- 2024TabDPT: Scaling Tabular Foundation Models on Real Datacited by 113
- 2019sktime: A Unified Interface for Machine Learning with Time Seriescited by 102
- 2022Computational Reproducibility Within Prognostics and Health Managementcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.