A Bayesian neural network predicts the dissolution of compact planetary systems
Not on the map. Why?
Abstract (arXiv)
Despite over three hundred years of effort, no solutions exist for predicting when a general planetary configuration will become unstable. We introduce a deep learning architecture to push forward this problem for compact systems. While current machine learning algorithms in this area rely on scientist-derived instability metrics, our new technique learns its own metrics from scratch, enabled by a novel internal structure inspired from dynamics theory. Our Bayesian neural network model can accurately predict not only if, but also when a compact planetary system with three or more planets will go unstable. Our model, trained directly from short N-body time series of raw orbital elements, is more than two orders of magnitude more accurate at predicting instability times than analytical estimators, while also reducing the bias of existing machine learning algorithms by nearly a factor of three. Despite being trained on compact resonant and near-resonant three-planet configurations, the model demonstrates robust generalization to both non-resonant and higher multiplicity configurations, in the latter case outperforming models fit to that specific set of integrations. The model computes instability estimates up to five orders of magnitude faster than a numerical integrator, and unlike previous efforts provides confidence intervals on its predictions. Our inference model is publicly available in the SPOCK package, with training code open-sourced.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 22 of its 86 references that are in the map. First posted on arXiv 11 Jan 2021.
Builds on
22 of 86 references.
References · 22
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
- 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
- 2015Weight Uncertainty in Neural Networkscited by 554
- 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
- 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 335
- 2017Stochastic Gradient Descent as Approximate Bayesian Inferencecited by 298
10 more
- 2018A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decaycited by 223
- 2017Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Ratescited by 196
- 2017Multiplicative Normalizing Flows for Variational Bayesian Neural Networkscited by 157
- 2020The Case for Bayesian Deep Learningcited by 68
- 2018Bayesian Layers: A Module for Neural Network Uncertaintycited by 57
- 2018Kymatio: Scattering Transforms in Pythoncited by 54
- 2019Learning Symbolic Physics with Graph Networkscited by 52
- 2020Is SGD a Bayesian sampler? Well, almostcited by 50
- 2017Implicit Weight Uncertainty in Neural Networkscited by 30
- 2020Hierarchical Inference With Bayesian Neural Networks: An Application to Strong Gravitational Lensingcited by 10
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 4; 2024: 4; 2025: 1.
15 papers.
Sort:
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 307
- 2023Multiple Physics Pretraining for Physical Surrogate Modelscited by 90
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AIcited by 60
- 2022On Uncertainty, Tempering, and Data Augmentation in Bayesian Classificationcited by 46
- 2023Geometric Clifford Algebra Networkscited by 37
- 2022Contrasting random and learned features in deep Bayesian linear regressioncited by 24
- 2024Sampling from Bayesian Neural Network Posteriors with Symmetric Minibatch Splitting Langevin Dynamicscited by 12
- 2022Robust Simulation-Based Inference in Cosmology with Bayesian Neural Networkscited by 11
- 2025Microcanonical Langevin Ensembles: Advancing the Sampling of Bayesian Neural Networkscited by 10
- 2023Masked Bayesian Neural Networks : Theoretical Guarantee and its Posterior Inferencecited by 9
- 2023ELF: Federated Langevin Algorithms with Primal, Dual and Bidirectional Compressioncited by 4
- 2022Leveraging Stochastic Predictions of Bayesian Neural Networks for Fluid Simulationscited by 3
3 more
- 2025Microcanonical Langevin Ensembles: Advancing the Sampling of Bayesian Neural Networks10 Feb 2025
- 2024Sampling from Bayesian Neural Network Posteriors with Symmetric Minibatch Splitting Langevin Dynamics14 Oct 2024
- 2024Functional Stochastic Gradient MCMC for Bayesian Neural Networks25 Sep 2024
- 2024Accelerating Giant Impact Simulations with Machine Learning16 Aug 2024
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI1 Feb 2024
- 2023Multiple Physics Pretraining for Physical Surrogate Models4 Oct 2023
- 2023Masked Bayesian Neural Networks : Theoretical Guarantee and its Posterior Inference24 May 2023
- 2023ELF: Federated Langevin Algorithms with Primal, Dual and Bidirectional Compression8 Mar 2023
- 2023Geometric Clifford Algebra Networks13 Feb 2023
- 2022Robust Simulation-Based Inference in Cosmology with Bayesian Neural Networks18 Jul 2022
- 2022Masked Bayesian Neural Networks : Computation and Optimality2 Jun 2022
- 2022Leveraging Stochastic Predictions of Bayesian Neural Networks for Fluid Simulations2 May 2022
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 307
- 2023Multiple Physics Pretraining for Physical Surrogate Modelscited by 90
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AIcited by 60
- 2022On Uncertainty, Tempering, and Data Augmentation in Bayesian Classificationcited by 46
- 2023Geometric Clifford Algebra Networkscited by 37
- 2022Contrasting random and learned features in deep Bayesian linear regressioncited by 24
- 2024Sampling from Bayesian Neural Network Posteriors with Symmetric Minibatch Splitting Langevin Dynamicscited by 12
- 2022Robust Simulation-Based Inference in Cosmology with Bayesian Neural Networkscited by 11
- 2025Microcanonical Langevin Ensembles: Advancing the Sampling of Bayesian Neural Networkscited by 10
- 2023Masked Bayesian Neural Networks : Theoretical Guarantee and its Posterior Inferencecited by 9
- 2023ELF: Federated Langevin Algorithms with Primal, Dual and Bidirectional Compressioncited by 4
- 2022Leveraging Stochastic Predictions of Bayesian Neural Networks for Fluid Simulationscited by 3
12 most cited of 15 All 15 (JSON)
- 2025Microcanonical Langevin Ensembles: Advancing the Sampling of Bayesian Neural Networks10 Feb 2025
- 2024Sampling from Bayesian Neural Network Posteriors with Symmetric Minibatch Splitting Langevin Dynamics14 Oct 2024
- 2024Functional Stochastic Gradient MCMC for Bayesian Neural Networks25 Sep 2024
- 2024Accelerating Giant Impact Simulations with Machine Learning16 Aug 2024
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI1 Feb 2024
- 2023Multiple Physics Pretraining for Physical Surrogate Models4 Oct 2023
- 2023Masked Bayesian Neural Networks : Theoretical Guarantee and its Posterior Inference24 May 2023
- 2023ELF: Federated Langevin Algorithms with Primal, Dual and Bidirectional Compression8 Mar 2023
- 2023Geometric Clifford Algebra Networks13 Feb 2023
- 2022Robust Simulation-Based Inference in Cosmology with Bayesian Neural Networks18 Jul 2022
- 2022Masked Bayesian Neural Networks : Computation and Optimality2 Jun 2022
- 2022Leveraging Stochastic Predictions of Bayesian Neural Networks for Fluid Simulations2 May 2022
12 newest of 15 All 15 (JSON)