Slim multi-scale convolutional autoencoder-based reduced-order models for interpretable features of a complex dynamical system
Not on the map. Why?
Abstract (arXiv)
In recent years, data-driven deep learning models have gained significant interest in the analysis of turbulent dynamical systems. Within the context of reduced-order models (ROMs), convolutional autoencoders (CAEs) pose a universally applicable alternative to conventional approaches. They can learn nonlinear transformations directly from data, without prior knowledge of the system. However, the features generated by such models lack interpretability. Thus, the resulting model is a black-box which effectively reduces the complexity of the system, but does not provide insights into the meaning of the latent features. To address this critical issue, we introduce a novel interpretable CAE approach for high-dimensional fluid flow data that maintains the reconstruction quality of conventional CAEs and allows for feature interpretation. Our method can be easily integrated into any existing CAE architecture with minor modifications of the training process. We compare our approach to Proper Orthogonal Decomposition (POD) and two existing methods for interpretable CAEs. We apply all methods to three different experimental turbulent Rayleigh-B'enard convection datasets with varying complexity. Our results show that the proposed method is lightweight, easy to train, and achieves relative reconstruction performance improvements of up to 6.4% over POD for 64 modes. The relative improvement increases to up to 229.8% as the number of modes decreases. Additionally, our method delivers interpretable features similar to those of POD and is significantly less resource-intensive than existing CAE approaches, using less than 2% of the parameters. These approaches either trade interpretability for reconstruction performance or only provide interpretability to a limited extend.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 46 references that are in the map. First posted on arXiv 6 Jan 2025.
Builds on
18 of 46 references.
References · 18
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2019Machine Learning for Fluid Mechanicscited by 380
- 2017The Effectiveness of Data Augmentation in Image Classification using Deep Learningcited by 368
- 2014Learning with Pseudo-Ensemblescited by 241
- 2018Visual Interpretability for Deep Learning: a Surveycited by 155
- 2018Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networkscited by 155
- 2021POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decompositioncited by 79
- 2018Deep convolutional recurrent autoencoders for learning low-dimensional feature dynamics of fluid systemscited by 54
- 2019ALIME: Autoencoder Based Approach for Local Interpretabilitycited by 41
- 2023Synthetic Lagrangian Turbulence by Generative Diffusion Modelscited by 31
- 2020An autoencoder-based reduced-order model for eigenvalue problems with application to neutron diffusioncited by 19
6 more
- 2017Analysis of dropout learning regarded as ensemble learningcited by 15
- 2020Reservoir computing model of two-dimensional turbulent convectioncited by 15
- 2021Nonlinear proper orthogonal decomposition for convection-dominated flowscited by 11
- 2022Flipped Classroom: Effective Teaching for Time Series Forecastingcited by 11
- 2022Direct data-driven forecast of local turbulent heat flux in Rayleigh-B'enard convectioncited by 10
- 2023Convolutional Autoencoders, Clustering and POD for Low-dimensional Parametrization of Navier-Stokes Equationscited by 3
Built on by
Not cited yet.