Prediction-Enhanced Monte Carlo: A Machine Learning View on Control Variate
Not on the map. Why?
Abstract (arXiv)
For many complex simulation tasks spanning areas such as healthcare, engineering, and finance, Monte Carlo (MC) methods are invaluable due to their unbiased estimates and precise error quantification. Nevertheless, Monte Carlo simulations often become computationally prohibitive, especially for nested, multi-level, or path-dependent evaluations lacking effective variance reduction techniques. While machine learning (ML) surrogates appear as natural alternatives, naive replacements typically introduce unquantifiable biases. We address this challenge by introducing Prediction-Enhanced Monte Carlo (PEMC), a framework that leverages modern ML models as learned predictors, using cheap and parallelizable simulation as features, to output unbiased evaluation with reduced variance and runtime. PEMC can also be viewed as a "modernized" view of control variates, where we consider the overall computation-cost-aware variance reduction instead of per-replication reduction, while bypassing the closed-form mean function requirement and maintaining the advantageous unbiasedness and uncertainty quantifiability of Monte Carlo. We illustrate PEMC's broader efficacy and versatility through three examples: first, equity derivatives such as variance swaps under stochastic local volatility models; second, interest rate derivatives such as swaption pricing under the Heath-Jarrow-Morton (HJM) interest-rate model. Finally, we showcase PEMC in a socially significant context - ambulance dispatch and hospital load balancing - where accurate mortality rate estimates are key for ethically sensitive decision-making. Across these diverse scenarios, PEMC consistently reduces variance while preserving unbiasedness, highlighting its potential as a powerful enhancement to standard Monte Carlo baselines.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 39 of its 147 references that are in the map. First posted on arXiv 15 Dec 2024.
Builds on
39 of 147 references.
References · 39
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2017Spectrally-normalized margin bounds for neural networkscited by 681
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
27 more
- 2016TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systemscited by 660
- 2016Error bounds for approximations with deep ReLU networkscited by 567
- 2017The Expressive Power of Neural Networks: A View from the Widthcited by 318
- 2017A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networkscited by 309
- 2018Stronger generalization bounds for deep nets via a compression approachcited by 306
- 2015Data-driven Distributionally Robust Optimization Using the Wasserstein Metric: Performance Guarantees and Tractable Reformulationscited by 285
- 2023Prediction-Powered Inferencecited by 214
- 2019Orthogonal Statistical Learningcited by 150
- 2018Survey of multifidelity methods in uncertainty propagation, inference, and optimizationcited by 141
- 2018Deep Hedgingcited by 106
- 2020Neural Network Approximation: Three Hidden Layers Are Enoughcited by 63
- 2014Control functionals for Monte Carlo integrationcited by 59
- 2023Cross-Prediction-Powered Inferencecited by 57
- 2024AutoEval Done Right: Using Synthetic Data for Model Evaluationcited by 53
- 2019Neural networks for option pricing and hedging: a literature reviewcited by 38
- 2020Neural Control Variatescited by 34
- 2019Unbiased Multilevel Monte Carlo: Stochastic Optimization, Steady-state Simulation, Quantiles, and Other Applicationscited by 17
- 2019Robust Importance Weighting for Covariate Shiftcited by 14
- 2020Demystifying Orthogonal Monte Carlo and Beyondcited by 8
- 2024Regression for the Mean: Auto-Evaluation and Inference with Few Labels through Post-hoc Regressioncited by 6
- 2018Unbiased deep solvers for linear parametric PDEscited by 5
- 2023Theoretical guarantees for neural control variates in MCMCcited by 4
- 2023When can Regression-Adjusted Control Variates Help? Rare Events, Sobolev Embedding and Minimax Optimalitycited by 4
- 2023Langevin Quasi-Monte Carlocited by 4
- 2021Doubly Robust Stein-Kernelized Monte Carlo Estimator: Simultaneous Bias-Variance Reduction and Supercanonical Convergencecited by 2
- 2017Multiperiod Martingale Transportcited by 1
- 2018Convergence to the Mean Field Game Limit: A Case Studycited by 1
Built on by
Citing papers per year: 2025: 2.
2 papers.