Applications of Gaussian Processes at Extreme Lengthscales: From Molecules to Black Holes
Not on the map. Why?
Abstract (arXiv)
In many areas of the observational and experimental sciences data is scarce. Data observation in high-energy astrophysics is disrupted by celestial occlusions and limited telescope time while data derived from laboratory experiments in synthetic chemistry and materials science is time and cost-intensive to collect. On the other hand, knowledge about the data-generation mechanism is often available in the sciences, such as the measurement error of a piece of laboratory apparatus. Both characteristics, small data and knowledge of the underlying physics, make Gaussian processes (GPs) ideal candidates for fitting such datasets. GPs can make predictions with consideration of uncertainty, for example in the virtual screening of molecules and materials, and can also make inferences about incomplete data such as the latent emission signature from a black hole accretion disc. Furthermore, GPs are currently the workhorse model for Bayesian optimisation, a methodology foreseen to be a guide for laboratory experiments in scientific discovery campaigns. The first contribution of this thesis is to use GP modelling to reason about the latent emission signature from the Seyfert galaxy Markarian 335, and by extension, to reason about the applicability of various theoretical models of black hole accretion discs. The second contribution is to extend the GP framework to molecular and chemical reaction representations and to provide an open-source software library to enable the framework to be used by scientists. The third contribution is to leverage GPs to discover novel and performant photoswitch molecules. The fourth contribution is to introduce a Bayesian optimisation scheme capable of modelling aleatoric uncertainty to facilitate the identification of material compositions that possess intrinsic robustness to large scale fabrication processes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 60 of its 452 references that are in the map. First posted on arXiv 24 Mar 2023.
Builds on
60 of 452 references.
References · 60
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
- 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 603
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
38 more
- 2019Attentive Neural Processescited by 280
- 2023Mathematical Capabilities of ChatGPTcited by 263
- 2020Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimizationcited by 176
- 2022Sample Efficiency Matters: A Benchmark for Practical Molecular Optimizationcited by 151
- 2021Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020cited by 146
- 2016GPflow: A Gaussian process library using TensorFlowcited by 139
- 2020Sample-Efficient Optimization in the Latent Space of Deep Generative Models via Weighted Retrainingcited by 121
- 2018Maximizing acquisition functions for Bayesian optimizationcited by 113
- 2022Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoderscited by 99
- 2022Local Latent Space Bayesian Optimization over Structured Inputscited by 78
- 2022MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Designcited by 66
- 2016Theano: A Python framework for fast computation of mathematical expressionscited by 64
- 2018Bayesian Optimization in AlphaGocited by 55
- 2020BOSS: Bayesian Optimization over String Spacescited by 54
- 2021High-Dimensional Bayesian Optimisation with Variational Autoencoders and Deep Metric Learningcited by 54
- 2020Optimizing Molecules using Efficient Queries from Property Evaluationscited by 50
- 2022Constrained Efficient Global Optimization of Expensive Black-box Functionscited by 49
- 2020A Framework for Interdomain and Multioutput Gaussian Processescited by 47
- 2014Student-t Processes as Alternatives to Gaussian Processescited by 45
- 2021Combining Latent Space and Structured Kernels for Bayesian Optimization over Combinatorial Spacescited by 45
- 2022TorchDrug: A Powerful and Flexible Machine Learning Platform for Drug Discoverycited by 45
- 2022GAUCHE: A Library for Gaussian Processes in Chemistrycited by 40
- 2020Causal Bayesian Optimizationcited by 39
- 2020Scalable Thompson Sampling using Sparse Gaussian Process Modelscited by 39
- 2019Approximate Inference for Fully Bayesian Gaussian Process Regressioncited by 31
- 2019BoTorch: A Framework for Efficient Monte-Carlo Bayesian Optimizationcited by 28
- 2020Transforming Gaussian Processes With Normalizing Flowscited by 28
- 2020Gaussian Process Molecule Property Prediction with FlowMOcited by 18
- 2020Bayesian Quantile and Expectile Optimisationcited by 17
- 2021Risk-averse Heteroscedastic Bayesian Optimizationcited by 17
- 2020Global Optimization of Gaussian processescited by 14
- 2021Assigning Confidence to Molecular Property Predictioncited by 14
- 2014An Entropy Search Portfolio for Bayesian Optimizationcited by 11
- 2021Data Considerations in Graph Representation Learning for Supply Chain Networkscited by 10
- 2022Calibration and generalizability of probabilistic models on low-data chemical datasets with DIONYSUScited by 10
- 2014Heteroscedastic Treed Bayesian Optimisationcited by 9
- 2020Are we Forgetting about Compositional Optimisers in Bayesian Optimisation?cited by 9
- 2020Compositional ADAM: An Adaptive Compositional Solvercited by 8
50 most cited of 60 All 60 (JSON)
Built on by
Not cited yet.