Quantile-constrained Wasserstein projections for robust interpretability of numerical and machine learning models
Not on the map. Why?
Abstract (arXiv)
Robustness studies of black-box models is recognized as a necessary task for numerical models based on structural equations and predictive models learned from data. These studies must assess the model's robustness to possible misspecification of regarding its inputs (e.g., covariate shift). The study of black-box models, through the prism of uncertainty quantification (UQ), is often based on sensitivity analysis involving a probabilistic structure imposed on the inputs, while ML models are solely constructed from observed data. Our work aim at unifying the UQ and ML interpretability approaches, by providing relevant and easy-to-use tools for both paradigms. To provide a generic and understandable framework for robustness studies, we define perturbations of input information relying on quantile constraints and projections with respect to the Wasserstein distance between probability measures, while preserving their dependence structure. We show that this perturbation problem can be analytically solved. Ensuring regularity constraints by means of isotonic polynomial approximations leads to smoother perturbations, which can be more suitable in practice. Numerical experiments on real case studies, from the UQ and ML fields, highlight the computational feasibility of such studies and provide local and global insights on the robustness of black-box models to input perturbations.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 34 of its 132 references that are in the map. First posted on arXiv 23 Sep 2022.
Builds on
34 of 132 references.
References · 34
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2016Universal adversarial perturbationscited by 774
- 2018Computational Optimal Transportcited by 765
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
- 2017Exploring Generalization in Deep Learningcited by 595
- 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
22 more
- 2015Learning with a Wasserstein Losscited by 194
- 2016Statistics of Robust Optimization: A Generalized Empirical Likelihood Approachcited by 182
- 2019Distribution Calibration for Regressioncited by 88
- 2020Beyond Pinball Loss: Quantile Methods for Calibrated Uncertainty Quantificationcited by 77
- 2021Look at the Variance! Efficient Black-box Explanations with Sobol-based Sensitivity Analysiscited by 65
- 2013Correlation and variable importance in random forestscited by 41
- 2020Statistical stability indices for LIME: obtaining reliable explanations for Machine Learning modelscited by 40
- 2020Generalization bounds for deep learningcited by 38
- 2019Adversarial Risk via Optimal Transport and Optimal Couplingscited by 36
- 2021Transport-based Counterfactual Modelscited by 27
- 2021Prior knowledge elicitation: The past, present, and futurecited by 23
- 2021SHAFF: Fast and consistent SHApley eFfect estimates via random Forestscited by 22
- 2017Variable selection for Gaussian processes via sensitivity analysis of the posterior predictive distributioncited by 15
- 2021Deep Learning Generalization and the Convex Hull of Training Setscited by 10
- 2021MDA for random forests: inconsistency, and a practical solution via the Sobol-MDAcited by 10
- 2019Sampling, Intervention, Prediction, Aggregation: A Generalized Framework for Model-Agnostic Interpretationscited by 9
- 2018Explaining Machine Learning Models using Entropic Variable Projectioncited by 5
- 2013Sensitivity analysis for Bayesian hierarchical modelscited by 4
- 2021Developments and applications of Shapley effects to reliability-oriented sensitivity analysis with correlated inputscited by 4
- 2016UTA-poly and UTA-splines: additive value functions with polynomial marginalscited by 3
- 2017A general framework for data-driven uncertainty quantification under complex input dependencies using vine copulascited by 3
- 2020A Primer on Domain Adaptationcited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 2; 2026: 1.
4 papers.
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2025Unveil Sources of Uncertainty: Feature Contribution to Conformal Prediction Intervalscited by 4
- 2025Wasserstein-Cram'er-Rao Theory of Unbiased Estimationcited by 2
- 2026Evaluating Black-Box Vulnerabilities with Wasserstein-Constrained Data Perturbationscited by 0
- 2026Evaluating Black-Box Vulnerabilities with Wasserstein-Constrained Data Perturbations16 Mar 2026
- 2025Wasserstein-Cram'er-Rao Theory of Unbiased Estimation10 Nov 2025
- 2025Unveil Sources of Uncertainty: Feature Contribution to Conformal Prediction Intervals19 May 2025
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review18 Mar 2023