mlsanityData to 7 Oct 2026

Liquid Fourier Latent Dynamics Networks for fast GPU-based numerical simulations in computational cardiology

arXiv 2408.09818 ↗First posted 19 Aug 2024cs.LG cs.CE cs.NEcited by 3

Not on the map. Why?

Abstract (arXiv)

Scientific Machine Learning (ML) is gaining momentum as a cost-effective alternative to physics-based numerical solvers in many engineering applications. In fact, scientific ML is currently being used to build accurate and efficient surrogate models starting from high-fidelity numerical simulations, effectively encoding the parameterized temporal dynamics underlying Ordinary Differential Equations (ODEs), or even the spatio-temporal behavior underlying Partial Differential Equations (PDEs), in appropriately designed neural networks. We propose an extension of Latent Dynamics Networks (LDNets), namely Liquid Fourier LDNets (LFLDNets), to create parameterized space-time surrogate models for multiscale and multiphysics sets of highly nonlinear differential equations on complex geometries. LFLDNets employ a neurologically-inspired, sparse, liquid neural network for temporal dynamics, relaxing the requirement of a numerical solver for time advancement and leading to superior performance in terms of tunable parameters, accuracy, efficiency and learned trajectories with respect to neural ODEs based on feedforward fully-connected neural networks. Furthermore, in our implementation of LFLDNets, we use a Fourier embedding with a tunable kernel in the reconstruction network to learn high-frequency functions better and faster than using space coordinates directly as input. We challenge LFLDNets in the framework of computational cardiology and evaluate their capabilities on two 3-dimensional test cases arising from multiscale cardiac electrophysiology and cardiovascular hemodynamics. This paper illustrates the capability to run Artificial Intelligence-based numerical simulations on single or multiple GPUs in a matter of minutes and represents a significant step forward in the development of physics-informed digital twins.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 37 of its 77 references that are in the map. First posted on arXiv 19 Aug 2024.

Builds on

37 of 77 references.

References · 37

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2018Neural Ordinary Differential Equationscited by 3,733
  4. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  5. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  6. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  7. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  8. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  9. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  10. 2024KAN: Kolmogorov-Arnold Networkscited by 634
  11. 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 516
  12. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
25 more
  1. 2019Augmented Neural ODEscited by 396
  2. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
  3. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  4. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
  5. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  6. 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
  7. 2020Liquid Time-constant Networkscited by 160
  8. 2022Physics-Informed Deep Neural Operator Networkscited by 110
  9. 2024A comprehensive and FAIR comparison between MLP and KAN representations for differential equations and operator networkscited by 103
  10. 2020Multiscale Simulations of Complex Systems by Learning their Effective Dynamicscited by 86
  11. 2024Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalizationcited by 78
  12. 2021Closed-form Continuous-time Neural Modelscited by 65
  13. 2024Neural Operators with Localized Integral and Differential Kernelscited by 59
  14. 2024Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEscited by 58
  15. 2022Multifidelity Deep Operator Networks For Data-Driven and Physics-Informed Problemscited by 57
  16. 2023Sequential Deep Operator Networks (S-DeepONet) for Predicting Full-field Solutions Under Time-dependent Loadscited by 47
  17. 2021Causal Navigation by Continuous-time Neural Networkscited by 23
  18. 2024The Empirical Impact of Neural Parameter Symmetries, or Lack Thereofcited by 21
  19. 2023Learning Reduced-Order Models for Cardiovascular Simulations with Graph Neural Networkscited by 20
  20. 2023SDF4CHD: Generative Modeling of Cardiac Anatomies with Congenital Heart Defectscited by 17
  21. 2023Shape of my heart: Cardiac models through learned signed distance functionscited by 10
  22. 2022A comprehensive and biophysically detailed computational model of the whole human heart electromechanicscited by 8
  23. 2021Modeling cardiac muscle fibers in ventricular and atrial electrophysiology simulationscited by 6
  24. 2021On the periodicity of cardiovascular fluid dynamics simulationscited by 5
  25. 2023Branched Latent Neural Mapscited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.