Multi-level Monte Carlo Dropout for Efficient Uncertainty Quantification
Not on the map. Why?
Abstract (arXiv)
We develop a multilevel Monte Carlo (MLMC) framework for uncertainty quantification with Monte Carlo dropout. Treating dropout masks as a source of epistemic randomness, we define a fidelity hierarchy by the number of stochastic forward passes used to estimate predictive moments. We construct coupled coarse--fine estimators by reusing dropout masks across fidelities, yielding telescoping MLMC estimators for both predictive means and predictive variances that remain unbiased for the corresponding dropout-induced quantities while reducing sampling variance at fixed evaluation budget. We derive explicit bias, variance and effective cost expressions, together with sample-allocation rules across levels. Numerical experiments on forward and inverse PINNs--Uzawa benchmarks confirm the predicted variance rates and demonstrate efficiency gains over single-level MC-dropout at matched cost.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 24 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
9 of 24 references.
References · 9
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
- 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 335
- 2020Multi-fidelity Bayesian Neural Networks: Algorithms and Applicationscited by 59
- 2019Multilevel Monte Carlo Variational Inferencecited by 15
- 2025Multilevel neural simulation-based inferencecited by 5
- 2025Surrogate Modelling of Proton Dose with Monte Carlo Dropout Uncertainty Quantificationcited by 1
Built on by
Not cited yet.