Geometry-aware Latent Autoregressive Generative Model for PDEs in Complex Domains
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Solving multiphysics partial differential equations (PDEs) remains a major challenge in scientific computing, especially for highly complex μm-scale tortuous geometries critical to energy and chemical engineering. We address this challenge by proposing a Geometry-aware Latent Autoregressive generative Model for PDEs (GeoLAMP), which solves physics within highly irregular and tortuous structures by decoupling flow and transport physics. GeoLAMP introduces a dual-encoder architecture on graph representations to jointly capture global topology and fine-scale geometric features, enabling an effective transition from real-space fields to compact latent representations. In the latent space, we propose a causal self-attention transformer with flow matching to model temporal dynamics, allowing stable and scalable block-wise autoregressive prediction. In addition, we propose a grid-graph data fusion scheme that projects low-resolution grid-based approximate priors onto graph representations, improving prediction of flow in tortuous structures. We establish three multiphysics benchmark datasets in complex geometries, covering reactive flow, heat convection, and elasticity. GeoLAMP consistently achieves the most stable autoregression performance on these datasets. Our results provide a systematic study of geometry-aware learning for PDEs in μm-scale complex geometries and offer new insights into block-wise time marching of latent autoregressive PDE modeling via a flow matching framework.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 43 of its 62 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
43 of 62 references.
Closest ancestors · 5
Same direction, newest first
- 2025Lost in Latent Space: An Empirical Study of Latent Diffusion Models for Physics Emulation3 Jul
- 2024DiffusionPDE: Generative PDE-Solving Under Partial Observation25 Jun
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers10 Aug
- 2022Flow Matching for Generative Modeling6 Oct
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
Other references · 38
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2017Neural Discrete Representation Learningcited by 4,712
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
26 more
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
- 2022Message Passing Neural PDE Solverscited by 386
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 297
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 221
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 204
- 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 151
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 145
- 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 82
- 2022Learning to Accelerate Partial Differential Equations via Latent Global Evolutioncited by 39
- 2023NUNO: A General Framework for Learning Parametric PDEs with Non-Uniform Datacited by 15
- 2021Point-Cloud Deep Learning of Porous Media for Permeability Predictioncited by 10
- 2026GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-Trainingcited by 10
- 2024M2PDE: Compositional Generative Multiphysics and Multi-component PDE Simulationcited by 5
- 2023Prediction of Effective Elastic Moduli of Rocks using Graph Neural Networkscited by 4
- 2026GenCP: Towards Generative Modeling Paradigm of Coupled Physicscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Text2PDE: Latent Diffusion Models for Accessible Physics Simulation
- 2026Latent Generative Solvers for Generalizable Long-Term Physics Simulation
- 2025ENMA: Tokenwise Autoregression for Generative Neural PDE Operators
- 2025Flow marching for a generative PDE foundation model
- 2025Towards a Foundation Model for Partial Differential Equations Across Physics Domains
- 2025Generative Latent Neural PDE Solver using Flow Matching
- 2026Advectra: Asymmetric Latent Transport for Non-Stationary Physics
- 2025Physics-aware generative models for turbulent fluid flows through energy-consistent stochastic interpolants