mlsanityData to 7 Oct 2026

Variational Rank Reduction Autoencoders for Generative Thermal Design

arXiv 2509.08515 ↗First posted 10 Sep 2025cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Generative thermal design for complex geometries is fundamental in many areas of engineering, yet it faces two main challenges: the high computational cost of high-fidelity simulations and the limitations of conventional generative models. Approaches such as autoencoders (AEs) and variational autoencoders (VAEs) often produce unstructured latent spaces with discontinuities, which restricts their capacity to explore designs and generate physically consistent solutions. To address these limitations, we propose a hybrid framework that combines Variational Rank-Reduction Autoencoders (VRRAEs) with Deep Operator Networks (DeepONets). The VRRAE introduces a truncated SVD within the latent space, leading to continuous, interpretable, and well-structured representations that mitigate posterior collapse and improve geometric reconstruction. The DeepONet then exploits this compact latent encoding in its branch network, together with spatial coordinates in the trunk network, to predict temperature gradients efficiently and accurately. This hybrid approach not only enhances the quality of generated geometries and the accuracy of gradient prediction, but also provides a substantial advantage in inference efficiency compared to traditional numerical solvers. Overall, the study underscores the importance of structured latent representations for operator learning and highlights the potential of combining generative models and operator networks in thermal design and broader engineering applications.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 65 references that are in the map. First posted on arXiv 10 Sep 2025.

Builds on

34 of 65 references.

References · 34

  1. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  2. 2019Topological Autoencoderscited by 124
  3. 2020A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEscited by 105
  4. 2021Deep Generative Models in Engineering Design: A Reviewcited by 103
  5. 2021POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decompositioncited by 79
  6. 2023β-Variational autoencoders and transformers for reduced-order modelling of fluid flowscited by 76
  7. 2024Latent Neural Operator for Solving Forward and Inverse PDE Problemscited by 76
  8. 2018Gaussian Process Prior Variational Autoencoderscited by 72
  9. 2022Learning two-phase microstructure evolution using neural operators and autoencoder architecturescited by 72
  10. 2021Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modelingcited by 59
  11. 2022Discovering Governing Equations from Partial Measurements with Deep Delay Autoencoderscited by 58
  12. 2024Geom-DeepONet: A Point-cloud-based Deep Operator Network for Field Predictions on 3D Parameterized Geometriescited by 47
22 more
  1. 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connectionscited by 47
  2. 2021Towards extraction of orthogonal and parsimonious non-linear modes from turbulent flowscited by 44
  3. 2023A graph convolutional autoencoder approach to model order reduction for parametrized PDEscited by 44
  4. 2020Deep learning of thermodynamics-aware reduced-order models from datacited by 38
  5. 2020Solving inverse-PDE problems with physics-aware neural networkscited by 27
  6. 2021Discovering Sparse Interpretable Dynamics from Partial Observationscited by 25
  7. 2019Extracting Interpretable Physical Parameters from Spatiotemporal Systems using Unsupervised Learningcited by 23
  8. 2022PI-VAE: Physics-Informed Variational Auto-Encoder for stochastic differential equationscited by 20
  9. 2024Physics-Informed Geometry-Aware Neural Operatorcited by 18
  10. 2024Inferring turbulent velocity and temperature fields and their statistics from Lagrangian velocity measurements using physics-informed Kolmogorov-Arnold Networkscited by 15
  11. 2021Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertaintycited by 11
  12. 2024Physics-Enhanced Machine Learning: a position paper for dynamical systems investigationscited by 11
  13. 2021Physics perception in sloshing scenes with guaranteed thermodynamic consistencycited by 10
  14. 2024Nonlinear model reduction for operator learningcited by 8
  15. 2025Thermodynamically Consistent Latent Dynamics Identification for Parametric Systemscited by 8
  16. 2022An unsupervised latent/output physics-informed convolutional-LSTM network for solving partial differential equations using peridynamic differential operatorcited by 7
  17. 2021An adaptive artificial neural network-based generative design method for layout designscited by 5
  18. 2023LatentPINNs: Generative physics-informed neural networks via a latent representation learningcited by 5
  19. 2024Thermodynamics-informed super-resolution of scarce temporal dynamics datacited by 3
  20. 2022Learning POD of Complex Dynamics Using Heavy-ball Neural ODEscited by 2
  21. 2024Real-Time 2D Temperature Field Prediction in Metal Additive Manufacturing Using Physics-Informed Neural Networkscited by 2
  22. 2025Variational Rank Reduction Autoencoderscited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.