Interpretable epistemic uncertainty decomposition in sequential generative models via polynomial chaos surrogates
Not on the map. Why?
Abstract (arXiv)
Sequential generative models conditioned on uncertain rewards are central to AI-driven scientific discovery, yet the epistemic uncertainty they inherit from imperfect reward estimates remains unquantified. We propagate this uncertainty through generative flow networks (GFlowNets) by fitting polynomial chaos expansions (PCEs) to small ensembles of trained models. The PCE coefficients yield analytical Sobol sensitivity indices, providing the first interpretable decomposition of which reward components drive which generative decisions, a capability unavailable from deep ensembles, Bayesian neural networks, or Monte Carlo dropout. Convergence guarantees are established theoretically and four of five are formally verified in the Lean 4 proof assistant. Across three real-world tasks the framework reveals actionable structure invisible to ensembles alone. On the Doyle-Dreher Buchwald-Hartwig dataset catalyst selection is robust (Dcatalyst≈ 71) while additive selection is fragile (Dadditive≈ 179, 2.5× higher). In fragment-based molecular design the linker position is the most sensitive (Dlinker≈ 28) while decoration positions are the most robust (D≈ 14-18), reversing the conventional scaffold-robust / decoration-fragile assumption. On the Sachs protein signalling network, MAPK-cascade edges and PKA/PKC hub edges separate into distinct sensitivity regimes, providing a targeted map for perturbation experiments. Calibration coverage at the 95% level reaches 0.97-1.00 across the dominant steps, and the surrogate evaluates 10,000 policy samples in milliseconds - 103-104× faster than exhaustive retraining.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 36 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
20 of 36 references.
References · 20
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2015Weight Uncertainty in Neural Networkscited by 554
- 2021Flow Network based Generative Models for Non-Iterative Diverse Candidate Generationcited by 392
- 2021GFlowNet Foundationscited by 290
- 2022Trajectory balance: Improved credit assignment in GFlowNetscited by 251
- 2022Biological Sequence Design with GFlowNetscited by 174
- 2022Bayesian Structure Learning with Generative Flow Networkscited by 153
- 2022Learning GFlowNets from partial episodes for improved convergence and stabilitycited by 132
- 2023Amortizing intractable inference in large language modelscited by 97
8 more
- 2023GFlowNets for AI-Driven Scientific Discoverycited by 63
- 2013Learning Gaussian Networkscited by 62
- 2023Multi-fidelity reduced-order surrogate modelingcited by 18
- 2025GFlowVLM: Enhancing Multi-step Reasoning in Vision-Language Models with Generative Flow Networkscited by 15
- 2024GFlowNet Fine-tuning for Diverse Correct Solutions in Mathematical Reasoning Taskscited by 8
- 2022PCENet: High Dimensional Surrogate Modeling for Learning Uncertaintycited by 5
- 2025Deep Polynomial Chaos Expansioncited by 4
- 2023The Deep Arbitrary Polynomial Chaos Neural Network or how Deep Artificial Neural Networks could benefit from Data-Driven Homogeneous Chaos Theorycited by 3
Built on by
Not cited yet.