mlsanityData to 14 Oct 2026

Latent Twins

arXiv 2509.20615 ↗First posted 24 Sep 2025cs.LG cs.NA math.NAcited by 3

Not on the map. Why?

Abstract (arXiv)

Over the past decade, scientific machine learning has transformed the development of mathematical and computational frameworks for analyzing, modeling, and predicting complex systems. From inverse problems to numerical PDEs, dynamical systems, and model reduction, these advances have pushed the boundaries of what can be simulated. Yet they have often progressed in parallel, with representation learning and algorithmic solution methods evolving largely as separate pipelines. With Latent Twins, we propose a unifying mathematical framework that creates a hidden surrogate in latent space for the underlying equations. Whereas digital twins mirror physical systems in the digital world, Latent Twins mirror mathematical systems in a learned latent space governed by operators. Through this lens, classical modeling, inversion, model reduction, and operator approximation all emerge as special cases of a single principle. We establish the fundamental approximation properties of Latent Twins for both ODEs and PDEs and demonstrate the framework across three representative settings: (i) canonical ODEs, capturing diverse dynamical regimes; (ii) a PDE benchmark using the shallow-water equations, contrasting Latent Twin simulations with DeepONet and forecasts with a 4D-Var baseline; and (iii) a challenging real-data geopotential reanalysis dataset, reconstructing and forecasting from sparse, noisy observations. Latent Twins provide a compact, interpretable surrogate for solution operators that evaluate across arbitrary time gaps in a single-shot, while remaining compatible with scientific pipelines such as assimilation, control, and uncertainty quantification. Looking forward, this framework offers scalable, theory-grounded surrogates that bridge data-driven representation learning and classical scientific modeling across disciplines.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 89 references that are in the map. First posted on arXiv 24 Sep 2025.

Builds on

32 of 89 references.

References · 32

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  3. 2016HyperNetworkscited by 1,027
  4. 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 599
  5. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
  6. 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 433
  7. 2019Are Transformers universal approximators of sequence-to-sequence functions?cited by 406
  8. 2017The Expressive Power of Neural Networks: A View from the Widthcited by 320
  9. 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 158
  10. 2014Dynamic mode decomposition with controlcited by 129
  11. 2019On the Turing Completeness of Modern Neural Network Architecturescited by 129
  12. 2018Universal approximations of invariant maps by neural networkscited by 127
20 more
  1. 2017Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problemscited by 107
  2. 2016Why does deep and cheap learning work so well?cited by 100
  3. 2023Score-based Data Assimilationcited by 96
  4. 2018Neural Proximal Gradient Descent for Compressive Imagingcited by 46
  5. 2022gLaSDI: Parametric Physics-informed Greedy Latent Space Dynamics Identificationcited by 30
  6. 2023GPLaSDI: Gaussian Process-based Interpretable Latent Space Dynamics Identification through Deep Autoencodercited by 30
  7. 2024tLaSDI: Thermodynamics-informed latent space dynamics identificationcited by 23
  8. 2024A Comprehensive Review of Latent Space Dynamics Identification Algorithms for Intrusive and Non-Intrusive Reduced-Order-Modelingcited by 22
  9. 2024Latent-EnSF: A Latent Ensemble Score Filter for High-Dimensional Data Assimilation with Sparse Observation Datacited by 22
  10. 2023Weak-Form Latent Space Dynamics Identificationcited by 20
  11. 2018Towards a Robust Parameterization for Conditioning Facies Models Using Deep Variational Autoencoders and Ensemble Smoothercited by 16
  12. 2021Attention-based Convolutional Autoencoders for 3D-Variational Data Assimilationcited by 15
  13. 2020Analog ensemble data assimilation and a method for constructing analogs with variational autoencoderscited by 12
  14. 2024Paired Autoencoders for Likelihood-free Estimation in Inverse Problemscited by 6
  15. 2024Efficient Training of Deep Neural Operator Networks via Randomized Samplingcited by 6
  16. 2025A Paired Autoencoder Framework for Inverse Problems via Bayes Risk Minimizationcited by 6
  17. 2024Paired Wasserstein Autoencoders for Conditional Samplingcited by 5
  18. 2025Ensemble Kalman filter in latent space using a variational autoencoder paircited by 5
  19. 2025Good Things Come in Pairs: Paired Autoencoders for Inverse Problemscited by 5
  20. 2015Strong Scaling for Numerical Weather Prediction at Petascale with the Atmospheric Model NUMAcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.