Constraining cosmological parameters from N-body simulations with Variational Bayesian Neural Networks
Not on the map. Why?
Abstract (arXiv)
Methods based on Deep Learning have recently been applied on astrophysical parameter recovery thanks to their ability to capture information from complex data. One of these methods is the approximate Bayesian Neural Networks (BNNs) which have demonstrated to yield consistent posterior distribution into the parameter space, helpful for uncertainty quantification. However, as any modern neural networks, they tend to produce overly confident uncertainty estimates and can introduce bias when BNNs are applied to data. In this work, we implement multiplicative normalizing flows (MNFs), a family of approximate posteriors for the parameters of BNNs with the purpose of enhancing the flexibility of the variational posterior distribution, to extract Omegam, h, and σ8 from the QUIJOTE simulations. We have compared this method with respect to the standard BNNs, and the flipout estimator. We found that MNFs combined with BNNs outperform the other models obtaining predictive performance with almost one order of magnitude larger that standard BNNs, σ8 extracted with high accuracy (r2=0.99), and precise uncertainty estimates. The latter implies that MNFs provide more realistic predictive distribution closer to the true posterior mitigating the bias introduced by the variational approximation and allowing to work with well-calibrated networks.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 20 of its 46 references that are in the map. First posted on arXiv 9 Jan 2023.
Builds on
20 of 46 references.
References · 20
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2016Density estimation using Real NVPcited by 2,029
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2016Ladder Variational Autoencoderscited by 315
- 2020Why Normalizing Flows Fail to Detect Out-of-Distribution Datacited by 220
- 2017Multiplicative Normalizing Flows for Variational Bayesian Neural Networkscited by 157
- 2018Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batchescited by 133
- 2015Hierarchical Variational Modelscited by 89
- 2018Randomized Value Functions via Multiplicative Normalizing Flowscited by 15
8 more
- 2017Estimating Cosmological Parameters from the Dark Matter Distributioncited by 11
- 2020Hierarchical Inference With Bayesian Neural Networks: An Application to Strong Gravitational Lensingcited by 10
- 20213D Convolutional Neural Networks for Stalled Brain Capillary Detectioncited by 8
- 2019Parameters Estimation for the Cosmic Microwave Background with Bayesian Neural Networkscited by 7
- 2021Bayesian Neural Networks: Essentialscited by 7
- 2022Machine Learning and Cosmologycited by 6
- 2020Constraining the Reionization History using Bayesian Normalizing Flowscited by 4
- 2021Constraining cosmological parameters from N-body simulations with Bayesian Neural Networkscited by 1
Built on by
Citing papers per year: 2024: 2.
2 papers.
- 2024Cosmology with Persistent Homology: Parameter Inference via Machine Learning19 Dec 2024
- 2024Forecasting VIX using Bayesian Deep Learning30 Jan 2024