mlsanityData to 7 Oct 2026

Applications of Gaussian Processes at Extreme Lengthscales: From Molecules to Black Holes

arXiv 2303.14291 ↗First posted 24 Mar 2023stat.ML astro-ph.HE astro-ph.IMcited by 0

Not on the map. Why?

Abstract (arXiv)

In many areas of the observational and experimental sciences data is scarce. Data observation in high-energy astrophysics is disrupted by celestial occlusions and limited telescope time while data derived from laboratory experiments in synthetic chemistry and materials science is time and cost-intensive to collect. On the other hand, knowledge about the data-generation mechanism is often available in the sciences, such as the measurement error of a piece of laboratory apparatus. Both characteristics, small data and knowledge of the underlying physics, make Gaussian processes (GPs) ideal candidates for fitting such datasets. GPs can make predictions with consideration of uncertainty, for example in the virtual screening of molecules and materials, and can also make inferences about incomplete data such as the latent emission signature from a black hole accretion disc. Furthermore, GPs are currently the workhorse model for Bayesian optimisation, a methodology foreseen to be a guide for laboratory experiments in scientific discovery campaigns. The first contribution of this thesis is to use GP modelling to reason about the latent emission signature from the Seyfert galaxy Markarian 335, and by extension, to reason about the applicability of various theoretical models of black hole accretion discs. The second contribution is to extend the GP framework to molecular and chemical reaction representations and to provide an open-source software library to enable the framework to be used by scientists. The third contribution is to leverage GPs to discover novel and performant photoswitch molecules. The fourth contribution is to introduce a Bayesian optimisation scheme capable of modelling aleatoric uncertainty to facilitate the identification of material compositions that possess intrinsic robustness to large scale fabrication processes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 60 of its 452 references that are in the map. First posted on arXiv 24 Mar 2023.

Builds on

60 of 452 references.

References · 60

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Graph Attention Networkscited by 8,854
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  6. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  7. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  8. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  9. 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
  10. 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 603
  11. 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
  12. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
38 more
  1. 2019Attentive Neural Processescited by 280
  2. 2023Mathematical Capabilities of ChatGPTcited by 263
  3. 2020Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimizationcited by 176
  4. 2022Sample Efficiency Matters: A Benchmark for Practical Molecular Optimizationcited by 151
  5. 2021Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020cited by 146
  6. 2016GPflow: A Gaussian process library using TensorFlowcited by 139
  7. 2020Sample-Efficient Optimization in the Latent Space of Deep Generative Models via Weighted Retrainingcited by 121
  8. 2018Maximizing acquisition functions for Bayesian optimizationcited by 113
  9. 2022Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoderscited by 99
  10. 2022Local Latent Space Bayesian Optimization over Structured Inputscited by 78
  11. 2022MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Designcited by 66
  12. 2016Theano: A Python framework for fast computation of mathematical expressionscited by 64
  13. 2018Bayesian Optimization in AlphaGocited by 55
  14. 2020BOSS: Bayesian Optimization over String Spacescited by 54
  15. 2021High-Dimensional Bayesian Optimisation with Variational Autoencoders and Deep Metric Learningcited by 54
  16. 2020Optimizing Molecules using Efficient Queries from Property Evaluationscited by 50
  17. 2022Constrained Efficient Global Optimization of Expensive Black-box Functionscited by 49
  18. 2020A Framework for Interdomain and Multioutput Gaussian Processescited by 47
  19. 2014Student-t Processes as Alternatives to Gaussian Processescited by 45
  20. 2021Combining Latent Space and Structured Kernels for Bayesian Optimization over Combinatorial Spacescited by 45
  21. 2022TorchDrug: A Powerful and Flexible Machine Learning Platform for Drug Discoverycited by 45
  22. 2022GAUCHE: A Library for Gaussian Processes in Chemistrycited by 40
  23. 2020Causal Bayesian Optimizationcited by 39
  24. 2020Scalable Thompson Sampling using Sparse Gaussian Process Modelscited by 39
  25. 2019Approximate Inference for Fully Bayesian Gaussian Process Regressioncited by 31
  26. 2019BoTorch: A Framework for Efficient Monte-Carlo Bayesian Optimizationcited by 28
  27. 2020Transforming Gaussian Processes With Normalizing Flowscited by 28
  28. 2020Gaussian Process Molecule Property Prediction with FlowMOcited by 18
  29. 2020Bayesian Quantile and Expectile Optimisationcited by 17
  30. 2021Risk-averse Heteroscedastic Bayesian Optimizationcited by 17
  31. 2020Global Optimization of Gaussian processescited by 14
  32. 2021Assigning Confidence to Molecular Property Predictioncited by 14
  33. 2014An Entropy Search Portfolio for Bayesian Optimizationcited by 11
  34. 2021Data Considerations in Graph Representation Learning for Supply Chain Networkscited by 10
  35. 2022Calibration and generalizability of probabilistic models on low-data chemical datasets with DIONYSUScited by 10
  36. 2014Heteroscedastic Treed Bayesian Optimisationcited by 9
  37. 2020Are we Forgetting about Compositional Optimisers in Bayesian Optimisation?cited by 9
  38. 2020Compositional ADAM: An Adaptive Compositional Solvercited by 8

50 most cited of 60 All 60 (JSON)

Built on by

Not cited yet.