Forecasting the outcome of spintronic experiments with Neural Ordinary Differential Equations
Not on the map. Why?
Abstract (arXiv)
Deep learning has an increasing impact to assist research, allowing, for example, the discovery of novel materials. Until now, however, these artificial intelligence techniques have fallen short of discovering the full differential equation of an experimental physical system. Here we show that a dynamical neural network, trained on a minimal amount of data, can predict the behavior of spintronic devices with high accuracy and an extremely efficient simulation time, compared to the micromagnetic simulations that are usually employed to model them. For this purpose, we re-frame the formalism of Neural Ordinary Differential Equations (ODEs) to the constraints of spintronics: few measured outputs, multiple inputs and internal parameters. We demonstrate with Spin-Neural ODEs an acceleration factor over 200 compared to micromagnetic simulations for a complex problem -- the simulation of a reservoir computer made of magnetic skyrmions (20 minutes compared to three days). In a second realization, we show that we can predict the noisy response of experimental spintronic nano-oscillators to varying inputs after training Spin-Neural ODEs on five milliseconds of their measured response to different excitations. Spin-Neural ODE is a disruptive tool for developing spintronic applications in complement to micromagnetic simulations, which are time-consuming and cannot fit experiments when noise or imperfections are present. Spin-Neural ODE can also be generalized to other electronic devices involving dynamics.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 21 of its 88 references that are in the map. First posted on arXiv 23 Jul 2021.
Builds on
21 of 88 references.
References · 21
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2019Hamiltonian Neural Networkscited by 702
- 2019Augmented Neural ODEscited by 396
- 2020Lagrangian Neural Networkscited by 388
- 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
- 2019Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learningcited by 205
- 2019Symplectic ODE-Net: Learning Hamiltonian Dynamics with Controlcited by 183
- 2020Dissecting Neural ODEscited by 150
- 2020Simplifying Hamiltonian and Lagrangian Neural Networks via Explicit Constraintscited by 102
- 2020On Second Order Behaviour in Augmented Neural ODEscited by 68
- 2020Parameterized Neural Ordinary Differential Equations: Applications to Computational Physics Problemscited by 45
9 more
- 2019Learning Dynamical Systems from Partial Observationscited by 36
- 2020Modeling System Dynamics with Physics-Informed Neural Networks Based on Lagrangian Mechanicscited by 32
- 2017Vowel recognition with four coupled spin-torque nano-oscillatorscited by 22
- 2018Spatio-Temporal Neural Networks for Space-Time Series Forecasting and Relations Discoverycited by 16
- 2020Stochasticity in Neural ODEs: An Empirical Studycited by 13
- 2020Constrained Neural Ordinary Differential Equations with Stability Guaranteescited by 13
- 2021Deep Neural Networks to Recover Unknown Physical Parameters from Oscillating Time Seriescited by 4
- 2016Magnetic skyrmion-based synaptic devicescited by 1
- 2019Extracting local switching fields in permanent magnets using machine learningcited by 1
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 6; 2025: 1; 2026: 2.
13 papers.
Sort:
- 2024On latent dynamics learning in nonlinear reduced order modelingcited by 14
- 2022A perspective on physical reservoir computing with nanomagnetic devicescited by 12
- 2022On the Forward Invariance of Neural ODEscited by 10
- 2024Efficient, Accurate and Stable Gradients for Neural ODEscited by 9
- 2023Bayesian Gaussian Process ODEs via Double Normalizing Flowscited by 7
- 2024Noise-Aware Training of Neuromorphic Dynamic Device Networkscited by 5
- 2023Correcting Auto-Differentiation in Neural-ODE Trainingcited by 1
- 2024Discover physical concepts and equations with machine learningcited by 1
- 2025High-order expansion of Neural Ordinary Differential Equations flowscited by 1
- 2026Learning Nonlinear Heterogeneity in Physical Kolmogorov-Arnold Networkscited by 1
- 2024Forecasting with an N-dimensional Langevin Equation and a Neural-Ordinary Differential Equationcited by 0
- 2024NeuralMAG: Fast and Generalizable Micromagnetic Simulation with Deep Neural Netscited by 0
- 2026FLARE: Flow Matching with Local Axis-Angle Representations for Stochastic Micromagnetic Evolution28 Sep 2026
- 2026Learning Nonlinear Heterogeneity in Physical Kolmogorov-Arnold Networks20 Jan 2026
- 2025High-order expansion of Neural Ordinary Differential Equations flows2 Apr 2025
- 2024Discover physical concepts and equations with machine learning11 Dec 2024
- 2024NeuralMAG: Fast and Generalizable Micromagnetic Simulation with Deep Neural Nets19 Oct 2024
- 2024Efficient, Accurate and Stable Gradients for Neural ODEs15 Oct 2024
- 2024On latent dynamics learning in nonlinear reduced order modeling27 Aug 2024
- 2024Forecasting with an N-dimensional Langevin Equation and a Neural-Ordinary Differential Equation12 May 2024
- 2024Noise-Aware Training of Neuromorphic Dynamic Device Networks14 Jan 2024
- 2023Bayesian Gaussian Process ODEs via Double Normalizing Flows17 Sep 2023
- 2023Correcting Auto-Differentiation in Neural-ODE Training3 Jun 2023
- 2022A perspective on physical reservoir computing with nanomagnetic devices9 Dec 2022
1 more
- 2022On the Forward Invariance of Neural ODEs10 Oct 2022
- 2024On latent dynamics learning in nonlinear reduced order modelingcited by 14
- 2022A perspective on physical reservoir computing with nanomagnetic devicescited by 12
- 2022On the Forward Invariance of Neural ODEscited by 10
- 2024Efficient, Accurate and Stable Gradients for Neural ODEscited by 9
- 2023Bayesian Gaussian Process ODEs via Double Normalizing Flowscited by 7
- 2024Noise-Aware Training of Neuromorphic Dynamic Device Networkscited by 5
- 2023Correcting Auto-Differentiation in Neural-ODE Trainingcited by 1
- 2024Discover physical concepts and equations with machine learningcited by 1
- 2025High-order expansion of Neural Ordinary Differential Equations flowscited by 1
- 2026Learning Nonlinear Heterogeneity in Physical Kolmogorov-Arnold Networkscited by 1
- 2024Forecasting with an N-dimensional Langevin Equation and a Neural-Ordinary Differential Equationcited by 0
- 2024NeuralMAG: Fast and Generalizable Micromagnetic Simulation with Deep Neural Netscited by 0
12 most cited of 13 All 13 (JSON)
- 2026FLARE: Flow Matching with Local Axis-Angle Representations for Stochastic Micromagnetic Evolution28 Sep 2026
- 2026Learning Nonlinear Heterogeneity in Physical Kolmogorov-Arnold Networks20 Jan 2026
- 2025High-order expansion of Neural Ordinary Differential Equations flows2 Apr 2025
- 2024Discover physical concepts and equations with machine learning11 Dec 2024
- 2024NeuralMAG: Fast and Generalizable Micromagnetic Simulation with Deep Neural Nets19 Oct 2024
- 2024Efficient, Accurate and Stable Gradients for Neural ODEs15 Oct 2024
- 2024On latent dynamics learning in nonlinear reduced order modeling27 Aug 2024
- 2024Forecasting with an N-dimensional Langevin Equation and a Neural-Ordinary Differential Equation12 May 2024
- 2024Noise-Aware Training of Neuromorphic Dynamic Device Networks14 Jan 2024
- 2023Bayesian Gaussian Process ODEs via Double Normalizing Flows17 Sep 2023
- 2023Correcting Auto-Differentiation in Neural-ODE Training3 Jun 2023
- 2022A perspective on physical reservoir computing with nanomagnetic devices9 Dec 2022
12 newest of 13 All 13 (JSON)