Augmented Neural ODEs
Not on the map. Why?
Abstract (arXiv)
We show that Neural Ordinary Differential Equations (ODEs) learn representations that preserve the topology of the input space and prove that this implies the existence of functions Neural ODEs cannot represent. To address these limitations, we introduce Augmented Neural ODEs which, in addition to being more expressive models, are empirically more stable, generalize better and have a lower computational cost than Neural ODEs.
Key facts. Cited by 396 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 86; 2022: 66; 2023: 59; 2024: 63; 2025: 62; 2026: 60.
396 papers.
Sort:
By area:
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 695
- 2021Score-based Generative Modeling in Latent Spacecited by 634
- 2021GRAND: Graph Neural Diffusioncited by 258
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2021Sinkformers: Transformers with Doubly Stochastic Attentioncited by 136
- 2022Liquid Structural State-Space Modelscited by 134
- 2021Neural Flows: Efficient Alternative to Neural ODEscited by 99
- 2024Normalizing Flows are Capable Generative Modelscited by 89
- 2021JFB: Jacobian-Free Backpropagation for Implicit Networkscited by 84
- 2021Beltrami Flow and Neural Diffusion on Graphscited by 84
- 2024Metric Flow Matching for Smooth Interpolations on the Data Manifoldcited by 74
38 more
- 2021On Training Implicit Modelscited by 73
- 2022Multivariate Time Series Forecasting with Dynamic Graph Neural ODEscited by 72
- 2021Stabilizing Equilibrium Models by Jacobian Regularizationcited by 71
- 2021Port-Hamiltonian Neural Networks for Learning Explicit Time-Dependent Dynamical Systemscited by 66
- 2021Closed-form Continuous-time Neural Modelscited by 65
- 2022Deep Equilibrium Optical Flow Estimationcited by 63
- 2021Neural ODE Processescited by 57
- 2024Mechanistic Design and Scaling of Hybrid Architecturescited by 57
- 2021Machine learning structure preserving brackets for forecasting irreversible processescited by 51
- 2021Integrating Expert ODEs into Neural ODEs: Pharmacology and Disease Progressioncited by 48
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
- 2022LyaNet: A Lyapunov Framework for Training Neural ODEscited by 43
- 2021MALI: A memory efficient and reverse accurate integrator for Neural ODEscited by 42
- 2021Survival Regression with Proper Scoring Rules and Monotonic Neural Networkscited by 42
- 2021Heavy Ball Neural Ordinary Differential Equationscited by 42
- 2021Neural Point Process for Learning Spatiotemporal Event Dynamicscited by 42
- 2022Deep Equilibrium Approaches to Diffusion Modelscited by 42
- 2021Learning Dynamic Alignment via Meta-filter for Few-shot Learningcited by 41
- 2021Neural Networks with Physics-Informed Architectures and Constraints for Dynamical Systems Modelingcited by 40
- 2021Continuous-Time Model-Based Reinforcement Learningcited by 39
- 2021Infinitely Deep Bayesian Neural Networks with Stochastic Differential Equationscited by 38
- 2022Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flowcited by 38
- 2021Momentum Residual Neural Networkscited by 36
- 2024Stable Neural Stochastic Differential Equations in Analyzing Irregular Time Series Datacited by 35
- 2021Constructing Neural Network-Based Models for Simulating Dynamical Systemscited by 29
- 2021Attentive Neural Controlled Differential Equations for Time-series Classification and Forecastingcited by 28
- 2021OCT-GAN: Neural ODE-based Conditional Tabular GANscited by 27
- 2022Do Residual Neural Networks discretize Neural Ordinary Differential Equations?cited by 27
- 2023Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusionscited by 27
- 2021Neural Delay Differential Equationscited by 26
- 2023Recurrence without Recurrence: Stable Video Landmark Detection with Deep Equilibrium Modelscited by 26
- 2022Neural Laplace: Learning diverse classes of differential equations in the Laplace domaincited by 24
- 2021Causal Navigation by Continuous-time Neural Networkscited by 23
- 2023An overview of differentiable particle filters for data-adaptive sequential Bayesian inferencecited by 23
- 2022EXIT: Extrapolation and Interpolation-based Neural Controlled Differential Equations for Time-series Classification and Forecastingcited by 22
- 2022Online Deep Equilibrium Learning for Regularization by Denoisingcited by 22
- 2022Alternating Differentiation for Optimization Layerscited by 22
- 2023Generative learning for nonlinear dynamicscited by 22
50 most cited of 396 All 396 (JSON)
- 2026Identifiability Guarantees for Drivers and Dynamics of Delayed Physical Systems29 Sep 2026
- 2026Identifying ODEs from Unstructured Data with Causal Representation Learning29 Sep 2026
- 2026LLN: Learnable Lens Networks for Parameter-Efficient Long-Horizon Dynamical Prediction28 Sep 2026
- 2026Neural ODEs Meet Concurrent Learning: Stable Online Learning with Lyapunov Guarantees26 Sep 2026
- 2026NEXT: Physics-Informed Neuro-Spectral Exponential Time Differencing Architectures25 Sep 2026
- 2026TinyUDE: Solver-Free Universal Differential Equations on Microcontrollers via Lie-Taylor Jet Matching22 Sep 2026
- 2026Deep learning emergent spacetime from fermionic spectral functions in holography16 Sep 2026
- 2026Continuous-Time Machine Learning: A Unified Mathematical Perspective15 Sep 2026
- 2026Privacy Preserving Gossip Learning13 Sep 2026
- 2026Data-Driven Learning of Unknown Nonlinear Differential Equations Using Functional Analysis3 Sep 2026
- 2026LLMODE: Aligning ODEs with LLMs via Gated Token Injection for Irregular Spatio-Temporal Forecasting30 Aug 2026
- 2026Learning Reduced-Order Dynamics with Singularity via Latent-Augmented Neural Ordinary Differential Equations22 Aug 2026
38 more
- 2026ODEWorld: A Continuous Predictive Architecture via Physical-Time Flow30 Jul 2026
- 2026Extending Fourier Neural Operators for Modeling Parameterized and Coupled PDEs26 Jul 2026
- 2026DINOde: Continuous Vision-Text Alignment for Open-Vocabulary Semantic Segmentation23 Jul 2026
- 2026Minimum Block Width for Universal Approximation by Residual Neural Networks with Inner Width One6 Jul 2026
- 2026Low-dimensional topology of deep neural networks30 Jun 2026
- 2026Neural Controlled Differential Equations for EMT-Level Surrogate Modeling of Grid-Forming Inverters28 Jun 2026
- 2026Autoregressive Boltzmann Generators25 Jun 2026
- 2026DT2: Decision-Targeted Digital Twins24 Jun 2026
- 2026Frequency-Domain Neural ODEs for Modeling Non-Linear Dynamical Systems20 Jun 2026
- 2026INDEQS: Informed Neural controlled Differential EQuationS17 Jun 2026
- 2026Learning Hybrid Biophysical Neuron Models with Neural ODEs15 Jun 2026
- 2026AugRelNet: Relation-Augmented Dynamics for Structure Discovery and Forecasting from Limited Data8 Jun 2026
- 2026Integrating Mechanistic and Data-Driven Models for Neurological Disorders through Differentiable Programming4 Jun 2026
- 2026Learning Transfers: Kan Extensions for Neural Invariants30 May 2026
- 2026Constructive interpolation and generalization rates for neural ODEs: a control perspective30 May 2026
- 2026Stochastic Lifting for Generating Trajectories of Stochastic Physical Systems28 May 2026
- 2026Holomorphic Neural ODEs with Kolmogorov-Arnold Networks for Interpretable Discovery of Complex Dynamics21 May 2026
- 2026Diffusion-Based Stochastic Operator Networks for Uncertainty Quantification in Stochastic Partial Differential Equations16 May 2026
- 2026Twincher: Bijective Representation Learning for Robust Inversion of Continuous Systems13 May 2026
- 2026MPINeuralODE: Multiple-Initial-Condition Physics-Informed Neural ODEs for Globally Consistent Dynamical System Learning13 May 2026
- 2026Neural Statistical Functions11 May 2026
- 2026Discovering Ordinary Differential Equations with LLM-Based Qualitative and Quantitative Evaluation8 May 2026
- 2026Activation Saturation and Floquet Spectrum Collapse in Neural ODEs1 Apr 2026
- 2026Universal Approximation Constraints of Narrow ResNets: The Tunnel Effect30 Mar 2026
- 2026Comparing Physics-Informed and Neural ODE Approaches for Modeling Nonlinear Biological Systems: A Case Study Based on the Morris-Lecar Model27 Mar 2026
- 2026Improving Infinitely Deep Bayesian Neural Networks with Nesterov's Accelerated Gradient Method26 Mar 2026
- 2026Flow matching on homogeneous spaces25 Mar 2026
- 2026An Invariant Compiler for Neural ODEs in AI-Accelerated Scientific Simulation25 Mar 2026
- 2026Bridging Discrete Marks and Continuous Dynamics: Dual-Path Cross-Interaction for Marked Temporal Point Processes12 Mar 2026
- 2026Stochastic Port-Hamiltonian Neural Networks: Universal Approximation with Passivity Guarantees10 Mar 2026
- 2026CHLU: The Causal Hamiltonian Learning Unit as a Symplectic Primitive for Deep Learning2 Mar 2026
- 2026Learning Physical Operators using Neural Operators26 Feb 2026
- 2026Deep Sequence Modeling with Quantum Dynamics: Language as a Wave Function24 Feb 2026
- 2026Controlled oscillation modeling using port-Hamiltonian neural networks17 Feb 2026
- 2026Continuous-Time Piecewise-Linear Recurrent Neural Networks17 Feb 2026
- 2026Out-of-Support Generalisation via Weight-Space Sequence Modelling14 Feb 2026
- 2026Oscillators Are All You Need: Irregular Time Series Modelling via Damped Harmonic Oscillators with Closed-Form Solutions12 Feb 2026
- 2026Knowledge Integration in Differentiable Models: A Comparative Study of Data-Driven, Soft-Constrained, and Hard-Constrained Paradigms for Identification and Control of the Single Machine Infinite Bus System10 Feb 2026
50 newest of 396 All 396 (JSON)
- 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 695
- 2021Score-based Generative Modeling in Latent Spacecited by 634
- 2024Metric Flow Matching for Smooth Interpolations on the Data Manifoldcited by 74
- 2022Deep Equilibrium Approaches to Diffusion Modelscited by 42
- 2023Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusionscited by 27
- 2024Trajectory Flow Matching with Applications to Clinical Time Series Modelingcited by 21
- 2023Deep Equilibrium Diffusion Restoration with Parallel Samplingcited by 17
- 2025CFO: Learning Continuous-Time PDE Dynamics via Flow-Matched Neural Operatorscited by 10
- 2024From Fourier to Neural ODEs: Flow Matching for Modeling Complex Systemscited by 9
- 2024Simulation-Free Training of Neural ODEs on Paired Datacited by 8
- 2024Switched Flow Matching: Eliminating Singularities via Switching ODEscited by 4
- 2024The Disappearance of Timestep Embedding in Modern Time-Dependent Neural Networkscited by 2
12 most cited of 14 All 14 (JSON)
- 2025CFO: Learning Continuous-Time PDE Dynamics via Flow-Matched Neural Operators4 Dec 2025
- 2025Fine-Tuning Flow Matching via Maximum Likelihood Estimation of Reconstructions2 Oct 2025
- 2025Time-reversed Flow Matching with Worst Transport in High-dimensional Latent Space for Image Anomaly Detection7 Aug 2025
- 2024Simulation-Free Training of Neural ODEs on Paired Data30 Oct 2024
- 2024Trajectory Flow Matching with Applications to Clinical Time Series Modeling28 Oct 2024
- 2024Metric Flow Matching for Smooth Interpolations on the Data Manifold23 May 2024
- 2024The Disappearance of Timestep Embedding in Modern Time-Dependent Neural Networks23 May 2024
- 2024Switched Flow Matching: Eliminating Singularities via Switching ODEs19 May 2024
- 2024From Fourier to Neural ODEs: Flow Matching for Modeling Complex Systems19 May 2024
- 2023Deep Equilibrium Diffusion Restoration with Parallel Sampling20 Nov 2023
- 2023Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusions14 Feb 2023
- 2022Deep Equilibrium Approaches to Diffusion Models23 Oct 2022
12 newest of 14 All 14 (JSON)
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2026ODEWorld: A Continuous Predictive Architecture via Physical-Time Flowcited by 4
- 2026ODEWorld: A Continuous Predictive Architecture via Physical-Time Flow30 Jul 2026
- 2022Flow Matching for Generative Modeling6 Oct 2022
- 2021GRAND: Graph Neural Diffusioncited by 258
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2021Sinkformers: Transformers with Doubly Stochastic Attentioncited by 136
- 2022Liquid Structural State-Space Modelscited by 134
- 2021Neural Flows: Efficient Alternative to Neural ODEscited by 99
- 2024Normalizing Flows are Capable Generative Modelscited by 89
- 2021JFB: Jacobian-Free Backpropagation for Implicit Networkscited by 84
- 2021Beltrami Flow and Neural Diffusion on Graphscited by 84
- 2021On Training Implicit Modelscited by 73
- 2022Multivariate Time Series Forecasting with Dynamic Graph Neural ODEscited by 72
- 2021Stabilizing Equilibrium Models by Jacobian Regularizationcited by 71
- 2021Port-Hamiltonian Neural Networks for Learning Explicit Time-Dependent Dynamical Systemscited by 66
12 most cited of 377 All 377 (JSON)
- 2026Identifiability Guarantees for Drivers and Dynamics of Delayed Physical Systems29 Sep 2026
- 2026Identifying ODEs from Unstructured Data with Causal Representation Learning29 Sep 2026
- 2026LLN: Learnable Lens Networks for Parameter-Efficient Long-Horizon Dynamical Prediction28 Sep 2026
- 2026Neural ODEs Meet Concurrent Learning: Stable Online Learning with Lyapunov Guarantees26 Sep 2026
- 2026NEXT: Physics-Informed Neuro-Spectral Exponential Time Differencing Architectures25 Sep 2026
- 2026TinyUDE: Solver-Free Universal Differential Equations on Microcontrollers via Lie-Taylor Jet Matching22 Sep 2026
- 2026Deep learning emergent spacetime from fermionic spectral functions in holography16 Sep 2026
- 2026Continuous-Time Machine Learning: A Unified Mathematical Perspective15 Sep 2026
- 2026Privacy Preserving Gossip Learning13 Sep 2026
- 2026Data-Driven Learning of Unknown Nonlinear Differential Equations Using Functional Analysis3 Sep 2026
- 2026LLMODE: Aligning ODEs with LLMs via Gated Token Injection for Irregular Spatio-Temporal Forecasting30 Aug 2026
- 2026Learning Reduced-Order Dynamics with Singularity via Latent-Augmented Neural Ordinary Differential Equations22 Aug 2026
12 newest of 377 All 377 (JSON)