mlsanityData to 7 Oct 2026

A Bayesian neural network predicts the dissolution of compact planetary systems

arXiv 2101.04117 ↗First posted 11 Jan 2021astro-ph.EP astro-ph.IM cs.AIcited by 15

Not on the map. Why?

Abstract (arXiv)

Despite over three hundred years of effort, no solutions exist for predicting when a general planetary configuration will become unstable. We introduce a deep learning architecture to push forward this problem for compact systems. While current machine learning algorithms in this area rely on scientist-derived instability metrics, our new technique learns its own metrics from scratch, enabled by a novel internal structure inspired from dynamics theory. Our Bayesian neural network model can accurately predict not only if, but also when a compact planetary system with three or more planets will go unstable. Our model, trained directly from short N-body time series of raw orbital elements, is more than two orders of magnitude more accurate at predicting instability times than analytical estimators, while also reducing the bias of existing machine learning algorithms by nearly a factor of three. Despite being trained on compact resonant and near-resonant three-planet configurations, the model demonstrates robust generalization to both non-resonant and higher multiplicity configurations, in the latter case outperforming models fit to that specific set of integrations. The model computes instability estimates up to five orders of magnitude faster than a numerical integrator, and unlike previous efforts provides confidence intervals on its predictions. Our inference model is publicly available in the SPOCK package, with training code open-sourced.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 22 of its 86 references that are in the map. First posted on arXiv 11 Jan 2021.

Builds on

22 of 86 references.

References · 22

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  4. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  5. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  6. 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
  7. 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
  8. 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
  9. 2015Weight Uncertainty in Neural Networkscited by 554
  10. 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
  11. 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 335
  12. 2017Stochastic Gradient Descent as Approximate Bayesian Inferencecited by 298
10 more
  1. 2018A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decaycited by 223
  2. 2017Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Ratescited by 196
  3. 2017Multiplicative Normalizing Flows for Variational Bayesian Neural Networkscited by 157
  4. 2020The Case for Bayesian Deep Learningcited by 68
  5. 2018Bayesian Layers: A Module for Neural Network Uncertaintycited by 57
  6. 2018Kymatio: Scattering Transforms in Pythoncited by 54
  7. 2019Learning Symbolic Physics with Graph Networkscited by 52
  8. 2020Is SGD a Bayesian sampler? Well, almostcited by 50
  9. 2017Implicit Weight Uncertainty in Neural Networkscited by 30
  10. 2020Hierarchical Inference With Bayesian Neural Networks: An Application to Strong Gravitational Lensingcited by 10

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 5; 2023: 4; 2024: 4; 2025: 1.

15 papers.

Sort: