Predictive Multiplicity in Survival Models: A Method for Quantifying Model Uncertainty in Predictive Maintenance Applications
Not on the map. Why?
Abstract (arXiv)
In many applications, especially those involving prediction, models may yield near-optimal performance yet significantly disagree on individual-level outcomes. This phenomenon, known as predictive multiplicity, has been formally defined in binary, probabilistic, and multi-target classification, and undermines the reliability of predictive systems. However, its implications remain unexplored in the context of survival analysis, which involves estimating the time until a failure or similar event while properly handling censored data. We frame predictive multiplicity as a critical concern in survival-based models and introduce formal measures -- ambiguity, discrepancy, and obscurity -- to quantify it. This is particularly relevant for downstream tasks such as maintenance scheduling, where precise individual risk estimates are essential. Understanding and reporting predictive multiplicity helps build trust in models deployed in high-stakes environments. We apply our methodology to benchmark datasets from predictive maintenance, extending the notion of multiplicity to survival models. Our findings show that ambiguity steadily increases, reaching up to 40-45% of observations; discrepancy is lower but exhibits a similar trend; and obscurity remains mild and concentrated in a few models. These results demonstrate that multiple accurate survival models may yield conflicting estimations of failure risk and degradation progression for the same equipment. This highlights the need to explicitly measure and communicate predictive multiplicity to ensure reliable decision-making in process health management.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 45 references that are in the map. First posted on arXiv 16 Apr 2025.
Builds on
21 of 45 references.
References · 21
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 819
- 2019Predictive Multiplicity in Classificationcited by 166
- 2024Amazing Things Come From Having Many Good Modelscited by 55
- 2022Predictive Multiplicity in Probabilistic Classificationcited by 44
- 2023Arbitrariness and Social Prediction: The Confounding Role of Variance in Fair Classificationcited by 32
- 2024Position: Explain to Question not to Justifycited by 20
- 2021Loss-Aversively Fair Classificationcited by 18
- 2023One Model Many Scores: Using Multiverse Analysis to Prevent Fairness Hacking and Evaluate the Influence of Model Design Decisionscited by 12
- 2023Multi-Target Multiplicity: Flexibility and Fairness in Target Specification under Resource Constraintscited by 11
- 2024An Experimental Study on the Rashomon Effect of Balancing Methods in Imbalanced Classificationcited by 11
- 2022Cross-model Fairness: Empirical Study of Fairness and Ethics Under Model Multiplicitycited by 8
9 more
- 2023Interpretable machine learning for time-to-event prediction in medicine and healthcarecited by 7
- 2024Reconciling Model Multiplicity for Downstream Decision Makingcited by 5
- 2023Energy-Based Survival Models for Predictive Maintenancecited by 4
- 2023Identifying Drivers of Predictive Aleatoric Uncertaintycited by 4
- 2024The Cost of Arbitrariness for Individuals: Examining the Legal and Technical Challenges of Model Multiplicitycited by 4
- 2022Predictive Maintenance using Machine Learningcited by 3
- 2024Practical Attribution Guidance for Rashomon Setscited by 3
- 2020Predictive maintenance on event logs: Application on an ATM fleetcited by 2
- 2025Rashomon perspective for measuring uncertainty in the survival predictive maintenance modelscited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.