mlsanityData to 7 Oct 2026

Branched Latent Neural Maps

arXiv 2308.02599 ↗First posted 4 Aug 2023cs.LG cs.NA eess.SPcited by 3

Not on the map. Why?

Abstract (arXiv)

We introduce Branched Latent Neural Maps (BLNMs) to learn finite dimensional input-output maps encoding complex physical processes. A BLNM is defined by a simple and compact feedforward partially-connected neural network that structurally disentangles inputs with different intrinsic roles, such as the time variable from model parameters of a differential equation, while transferring them into a generic field of interest. BLNMs leverage latent outputs to enhance the learned dynamics and break the curse of dimensionality by showing excellent generalization properties with small training datasets and short training times on a single processor. Indeed, their generalization error remains comparable regardless of the adopted discretization during the testing phase. Moreover, the partial connections significantly reduce the number of tunable parameters. We show the capabilities of BLNMs in a challenging test case involving electrophysiology simulations in a biventricular cardiac model of a pediatric patient with hypoplastic left heart syndrome. The model includes a 1D Purkinje network for fast conduction and a 3D heart-torso geometry. Specifically, we trained BLNMs on 150 in silico generated 12-lead electrocardiograms (ECGs) while spanning 7 model parameters, covering cell-scale and organ-level. Although the 12-lead ECGs manifest very fast dynamics with sharp gradients, after automatic hyperparameter tuning the optimal BLNM, trained in less than 3 hours on a single CPU, retains just 7 hidden layers and 19 neurons per layer. The resulting mean square error is on the order of 10-4 on a test dataset comprised of 50 electrophysiology simulations. In the online phase, the BLNM allows for 5000x faster real-time simulations of cardiac electrophysiology on a single core standard computer and can be used to solve inverse problems via global optimization in a few seconds of computational time.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 25 of its 73 references that are in the map. First posted on arXiv 4 Aug 2023.

Builds on

25 of 73 references.

References · 25

  1. 2018Neural Ordinary Differential Equationscited by 3,733
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  3. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  4. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
  5. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
  6. 2019Augmented Neural ODEscited by 396
  7. 2020Universal Differential Equations for Scientific Machine Learningcited by 345
  8. 2020Liquid Time-constant Networkscited by 160
  9. 2020A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEscited by 105
  10. 2020Multiscale Simulations of Complex Systems by Learning their Effective Dynamicscited by 86
  11. 2021POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decompositioncited by 79
  12. 2023β-Variational autoencoders and transformers for reduced-order modelling of fluid flowscited by 76
13 more
  1. 2022Reliable extrapolation of deep neural operators informed by physics or sparse observationscited by 62
  2. 2022Multifidelity Deep Operator Networks For Data-Driven and Physics-Informed Problemscited by 57
  3. 2023A graph convolutional autoencoder approach to model order reduction for parametrized PDEscited by 44
  4. 2020nPINNs: nonlocal Physics-Informed Neural Networks for a parametrized nonlocal universal Laplacian operator. Algorithms and Applicationscited by 36
  5. 2021A Metalearning Approach for Physics-Informed Neural Networks (PINNs): Application to Parameterized PDEscited by 31
  6. 2020Deep learning-based reduced order models in cardiac electrophysiologycited by 22
  7. 2023Learning Reduced-Order Models for Cardiovascular Simulations with Graph Neural Networkscited by 20
  8. 2022Long-time prediction of nonlinear parametrized dynamical systems by deep learning-based reduced order modelscited by 10
  9. 2022A comprehensive and biophysically detailed computational model of the whole human heart electromechanicscited by 8
  10. 2021Modeling cardiac muscle fibers in ventricular and atrial electrophysiology simulationscited by 6
  11. 2023Adaptive learning of effective dynamics: Adaptive real-time, online modeling for complex systemscited by 4
  12. 2023Latent Dynamics Networks (LDNets): learning the intrinsic dynamics of spatio-temporal processescited by 4
  13. 2018The importance of the pericardium for cardiac biomechanics: From physiology to computational modelingcited by 3

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 1.

3 papers.