mlsanityData to 7 Oct 2026

Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning

arXiv 2202.05460 ↗First posted 11 Feb 2022cs.CE cs.LG math-phcited by 12

Not on the map. Why?

Abstract (arXiv)

We propose a unified data-driven reduced order model (ROM) that bridges the performance gap between linear and nonlinear manifold approaches. Deep learning ROM (DL-ROM) using deep-convolutional autoencoders (DC-AE) has been shown to capture nonlinear solution manifolds but fails to perform adequately when linear subspace approaches such as proper orthogonal decomposition (POD) would be optimal. Besides, most DL-ROM models rely on convolutional layers, which might limit its application to only a structured mesh. The proposed framework in this study relies on the combination of an autoencoder (AE) and Barlow Twins (BT) self-supervised learning, where BT maximizes the information content of the embedding with the latent space through a joint embedding architecture. Through a series of benchmark problems of natural convection in porous media, BT-AE performs better than the previous DL-ROM framework by providing comparable results to POD-based approaches for problems where the solution lies within a linear subspace as well as DL-ROM autoencoder-based techniques where the solution lies on a nonlinear manifold; consequently, bridges the gap between linear and nonlinear reduced manifolds. Furthermore, this BT-AE framework can operate on unstructured meshes, which provides flexibility in its application to standard numerical solvers, on-site measurements, experimental data, or a combination of these sources.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 15 of its 76 references that are in the map. First posted on arXiv 11 Feb 2022.

Builds on

15 of 76 references.

References · 15

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  3. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  4. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  5. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  6. 2020A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEscited by 105
  7. 2020A fast and accurate physics-informed neural network reduced order model with shallow masked autoencodercited by 80
  8. 2021A framework for data-driven solution and parameter estimation of PDEs using conditional generative adversarial networkscited by 30
  9. 2021Non-intrusive reduced order modeling of natural convection in porous media using convolutional autoencoders: comparison with linear subspace techniquescited by 23
  10. 2020Physics-informed Neural Networks for Solving Nonlinear Diffusivity and Biot's equationscited by 20
  11. 2020Efficient nonlinear manifold reduced order modelcited by 17
  12. 2021Nonlinear proper orthogonal decomposition for convection-dominated flowscited by 11
3 more
  1. 2021Non-intrusive reduced order modeling of poroelasticity of heterogeneous media based on a discontinuous Galerkin approximationcited by 6
  2. 2020A Locally Conservative Mixed Finite Element Framework for Coupled Hydro-Mechanical-Chemical Processes in Heterogeneous Porous Mediacited by 5
  3. 2017Benchmarks for single-phase flow in fractured porous mediacited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 4; 2024: 2; 2025: 1; 2026: 3.

12 papers.