Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning
Not on the map. Why?
Abstract (arXiv)
We propose a unified data-driven reduced order model (ROM) that bridges the performance gap between linear and nonlinear manifold approaches. Deep learning ROM (DL-ROM) using deep-convolutional autoencoders (DC-AE) has been shown to capture nonlinear solution manifolds but fails to perform adequately when linear subspace approaches such as proper orthogonal decomposition (POD) would be optimal. Besides, most DL-ROM models rely on convolutional layers, which might limit its application to only a structured mesh. The proposed framework in this study relies on the combination of an autoencoder (AE) and Barlow Twins (BT) self-supervised learning, where BT maximizes the information content of the embedding with the latent space through a joint embedding architecture. Through a series of benchmark problems of natural convection in porous media, BT-AE performs better than the previous DL-ROM framework by providing comparable results to POD-based approaches for problems where the solution lies within a linear subspace as well as DL-ROM autoencoder-based techniques where the solution lies on a nonlinear manifold; consequently, bridges the gap between linear and nonlinear reduced manifolds. Furthermore, this BT-AE framework can operate on unstructured meshes, which provides flexibility in its application to standard numerical solvers, on-site measurements, experimental data, or a combination of these sources.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 15 of its 76 references that are in the map. First posted on arXiv 11 Feb 2022.
Builds on
15 of 76 references.
References · 15
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2020A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEscited by 105
- 2020A fast and accurate physics-informed neural network reduced order model with shallow masked autoencodercited by 80
- 2021A framework for data-driven solution and parameter estimation of PDEs using conditional generative adversarial networkscited by 30
- 2021Non-intrusive reduced order modeling of natural convection in porous media using convolutional autoencoders: comparison with linear subspace techniquescited by 23
- 2020Physics-informed Neural Networks for Solving Nonlinear Diffusivity and Biot's equationscited by 20
- 2020Efficient nonlinear manifold reduced order modelcited by 17
- 2021Nonlinear proper orthogonal decomposition for convection-dominated flowscited by 11
3 more
- 2021Non-intrusive reduced order modeling of poroelasticity of heterogeneous media based on a discontinuous Galerkin approximationcited by 6
- 2020A Locally Conservative Mixed Finite Element Framework for Coupled Hydro-Mechanical-Chemical Processes in Heterogeneous Porous Mediacited by 5
- 2017Benchmarks for single-phase flow in fractured porous mediacited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 2; 2025: 1; 2026: 3.
12 papers.
- 2022gLaSDI: Parametric Physics-informed Greedy Latent Space Dynamics Identificationcited by 30
- 2024Physics-informed active learning with simultaneous weak-form latent space dynamics identificationcited by 13
- 2023Generative Adversarial Reduced Order Modellingcited by 7
- 2023State Representation Learning Using an Unbalanced Atlascited by 3
- 2026Surrogates for Physics-based and Data-driven Modelling of Parametric Systems: Review and New Perspectivescited by 2
- 2022Enhancing Dynamic Mode Decomposition Workflow with In-Situ Visualization and Data Compressioncited by 1
- 2026Contrastive Learning Boosts Deterministic and Generative Models for Weather Datacited by 1
- 2023Progressive reduced order modeling: empowering data-driven modeling with selective knowledge transfercited by 0
- 2023Efficient machine-learning surrogates for large-scale geological carbon and energy storagecited by 0
- 2024Maximum Manifold Capacity Representations in State Representation Learningcited by 0
- 2025Physics-Informed Neural Networks for Control of Single-Phase Flow Systems Governed by Partial Differential Equationscited by 0
- 2026Sparse POD Mode Selection and Manifold Dimensionality Reduction with Neural Networkscited by 0
- 2026Sparse POD Mode Selection and Manifold Dimensionality Reduction with Neural Networks26 May 2026
- 2026Contrastive Learning Boosts Deterministic and Generative Models for Weather Data25 Mar 2026
- 2026Surrogates for Physics-based and Data-driven Modelling of Parametric Systems: Review and New Perspectives13 Mar 2026
- 2025Physics-Informed Neural Networks for Control of Single-Phase Flow Systems Governed by Partial Differential Equations6 Jun 2025
- 2024Physics-informed active learning with simultaneous weak-form latent space dynamics identification29 Jun 2024
- 2024Maximum Manifold Capacity Representations in State Representation Learning22 May 2024
- 2023Efficient machine-learning surrogates for large-scale geological carbon and energy storage11 Oct 2023
- 2023Progressive reduced order modeling: empowering data-driven modeling with selective knowledge transfer4 Oct 2023
- 2023Generative Adversarial Reduced Order Modelling25 May 2023
- 2023State Representation Learning Using an Unbalanced Atlas17 May 2023
- 2022Enhancing Dynamic Mode Decomposition Workflow with In-Situ Visualization and Data Compression16 Aug 2022
- 2022gLaSDI: Parametric Physics-informed Greedy Latent Space Dynamics Identification26 Apr 2022