Decoder Decomposition for the Analysis of the Latent Space of Nonlinear Autoencoders With Wind-Tunnel Experimental Data
Not on the map. Why?
Abstract (arXiv)
Turbulent flows are chaotic and multi-scale dynamical systems, which have large numbers of degrees of freedom. Turbulent flows, however, can be modelled with a smaller number of degrees of freedom when using the appropriate coordinate system, which is the goal of dimensionality reduction via nonlinear autoencoders. Autoencoders are expressive tools, but they are difficult to interpret. The goal of this paper is to propose a method to aid the interpretability of autoencoders. This is the decoder decomposition. First, we propose the decoder decomposition, which is a post-processing method to connect the latent variables to the coherent structures of flows. Second, we apply the decoder decomposition to analyse the latent space of synthetic data of a two-dimensional unsteady wake past a cylinder. We find that the dimension of latent space has a significant impact on the interpretability of autoencoders. We identify the physical and spurious latent variables. Third, we apply the decoder decomposition to the latent space of wind-tunnel experimental data of a three-dimensional turbulent wake past a bluff body. We show that the reconstruction error is a function of both the latent space dimension and the decoder size, which are correlated. Finally, we apply the decoder decomposition to rank and select latent variables based on the coherent structures that they represent. This is useful to filter unwanted or spurious latent variables, or to pinpoint specific coherent structures of interest. The ability to rank and select latent variables will help users design and interpret nonlinear autoencoders.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 12 of its 44 references that are in the map. First posted on arXiv 25 Apr 2024.
Builds on
12 of 44 references.
References · 12
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2018An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solutioncited by 302
- 2023β-Variational autoencoders and transformers for reduced-order modelling of fluid flowscited by 76
- 2021Learning in Sinusoidal Spaces with Physics-Informed Neural Networkscited by 61
- 2017All You Need is Beyond a Good Init: Exploring Better Solution for Training Extremely Deep Convolutional Neural Networks with Orthonormality and Modulationcited by 58
- 2021Towards extraction of orthogonal and parsimonious non-linear modes from turbulent flowscited by 44
- 2021Interpretable deep-learning models to help achieve the Sustainable Development Goalscited by 18
- 2023Grasping Extreme Aerodynamics on a Low-Dimensional Manifoldcited by 18
- 2021Symmetry-Aware Autoencoders: s-PCA and s-nlPCAcited by 8
- 2020Auto-Encoded Reservoir Computing for Turbulence Learningcited by 7
- 2022On interpretability and proper latent decomposition of autoencoderscited by 6
- 2023Convolutional autoencoder for the spatiotemporal latent representation of turbulencecited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.