Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidance
Not on the map. Why?
Abstract (arXiv)
This paper proposes a two-stage framework named ST-PAD for spatio-temporal fluid dynamics modeling in the field of earth sciences, aiming to achieve high-precision simulation and prediction of fluid dynamics through spatio-temporal physics awareness and parameter diffusion guidance. In the upstream stage, we design a vector quantization reconstruction module with temporal evolution characteristics, ensuring balanced and resilient parameter distribution by introducing general physical constraints. In the downstream stage, a diffusion probability network involving parameters is utilized to generate high-quality future states of fluids, while enhancing the model's generalization ability by perceiving parameters in various physical setups. Extensive experiments on multiple benchmark datasets have verified the effectiveness and robustness of the ST-PAD framework, which showcase that ST-PAD outperforms current mainstream models in fluid dynamics modeling and prediction, especially in effectively capturing local representations and maintaining significant advantages in OOD generations.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 72 of its 112 references that are in the map. First posted on arXiv 18 Mar 2024.
Builds on
72 of 112 references.
References · 72
- 2017Neural Discrete Representation Learningcited by 4,650
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2022Mixture-of-Experts with Expert Choice Routingcited by 611
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
38 more
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2015Unsupervised Learning of Video Representations using LSTMscited by 434
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
- 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
- 2017PDE-Net: Learning PDEs from Datacited by 304
- 2022Perception Prioritized Training of Diffusion Modelscited by 301
- 2015Deep multi-scale video prediction beyond mean square errorcited by 297
- 2021Graph Contrastive Learning Automatedcited by 287
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
- 2021Factorized Fourier Neural Operatorscited by 237
- 2017Stochastic Variational Video Predictioncited by 234
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
- 2021Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemscited by 220
- 2022U-NO: U-shaped Neural Operatorscited by 219
- 2022Improving Out-of-Distribution Robustness via Selective Augmentationcited by 202
- 2019Scaling Autoregressive Video Modelscited by 189
- 2022Discovering Invariant Rationales for Graph Neural Networkscited by 186
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
- 2022SimVP: Simpler yet Better Video Predictioncited by 181
- 2015Action-Conditional Video Prediction using Deep Networks in Atari Gamescited by 171
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 164
- 2022Handling Distribution Shifts on Graphs: An Invariance Perspectivecited by 163
- 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
- 2022Uncertainty Modeling for Out-of-Distribution Generalizationcited by 122
- 2019PPINN: Parareal Physics-Informed Neural Network for time-dependent PDEscited by 116
- 2020A Review on Deep Learning Techniques for Video Predictioncited by 114
- 2021Towards a Theoretical Framework of Out-of-Distribution Generalizationcited by 94
- 2021CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Methodcited by 93
- 2022Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learningcited by 84
- 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
- 2021Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codescited by 71
- 2023Discover and Cure: Concept-aware Mitigation of Spurious Correlationcited by 71
- 2018SOM-VAE: Interpretable Discrete Representation Learning on Time Seriescited by 59
50 most cited of 72 All 72 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 3.
5 papers.
- 2025Turb-L1: Achieving Long-term Turbulence Tracing By Tackling Spectral Biascited by 9
- 2025FD-Bench: A Modular and Fair Benchmark for Data-driven Fluid Simulationcited by 4
- 2024Learning Lagrangian Interaction Dynamics with Sampling-Based Model Order Reductioncited by 2
- 2025PAINET: A Principled Efficient Transformer for 3D Dynamics Modelingcited by 2
- 2024SLFNet: Generating Semantic Logic Forms from Natural Language Using Semantic Probability Graphscited by 1
- 2025PAINET: A Principled Efficient Transformer for 3D Dynamics Modeling5 Oct 2025
- 2025FD-Bench: A Modular and Fair Benchmark for Data-driven Fluid Simulation25 May 2025
- 2025Turb-L1: Achieving Long-term Turbulence Tracing By Tackling Spectral Bias25 May 2025
- 2024Learning Lagrangian Interaction Dynamics with Sampling-Based Model Order Reduction4 Jul 2024
- 2024SLFNet: Generating Semantic Logic Forms from Natural Language Using Semantic Probability Graphs29 Mar 2024