mlsanityData to 7 Oct 2026

Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidance

arXiv 2403.13850 ↗First posted 18 Mar 2024cs.LG cs.AI physics.flu-dyncited by 5

Not on the map. Why?

Abstract (arXiv)

This paper proposes a two-stage framework named ST-PAD for spatio-temporal fluid dynamics modeling in the field of earth sciences, aiming to achieve high-precision simulation and prediction of fluid dynamics through spatio-temporal physics awareness and parameter diffusion guidance. In the upstream stage, we design a vector quantization reconstruction module with temporal evolution characteristics, ensuring balanced and resilient parameter distribution by introducing general physical constraints. In the downstream stage, a diffusion probability network involving parameters is utilized to generate high-quality future states of fluids, while enhancing the model's generalization ability by perceiving parameters in various physical setups. Extensive experiments on multiple benchmark datasets have verified the effectiveness and robustness of the ST-PAD framework, which showcase that ST-PAD outperforms current mainstream models in fluid dynamics modeling and prediction, especially in effectively capturing local representations and maintaining significant advantages in OOD generations.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 72 of its 112 references that are in the map. First posted on arXiv 18 Mar 2024.

Builds on

72 of 112 references.

References · 72

  1. 2017Neural Discrete Representation Learningcited by 4,650
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  3. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  5. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  6. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  7. 2022Diffusion Models in Vision: A Surveycited by 1,008
  8. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  9. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  10. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  11. 2022Mixture-of-Experts with Expert Choice Routingcited by 611
  12. 2022Vision Transformer Adapter for Dense Predictionscited by 564
38 more
  1. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  2. 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
  3. 2015Unsupervised Learning of Video Representations using LSTMscited by 434
  4. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
  5. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
  6. 2021Choose a Transformer: Fourier or Galerkincited by 333
  7. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  8. 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
  9. 2017PDE-Net: Learning PDEs from Datacited by 304
  10. 2022Perception Prioritized Training of Diffusion Modelscited by 301
  11. 2015Deep multi-scale video prediction beyond mean square errorcited by 297
  12. 2021Graph Contrastive Learning Automatedcited by 287
  13. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
  14. 2021Factorized Fourier Neural Operatorscited by 237
  15. 2017Stochastic Variational Video Predictioncited by 234
  16. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
  17. 2021Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemscited by 220
  18. 2022U-NO: U-shaped Neural Operatorscited by 219
  19. 2022Improving Out-of-Distribution Robustness via Selective Augmentationcited by 202
  20. 2019Scaling Autoregressive Video Modelscited by 189
  21. 2022Discovering Invariant Rationales for Graph Neural Networkscited by 186
  22. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
  23. 2022SimVP: Simpler yet Better Video Predictioncited by 181
  24. 2015Action-Conditional Video Prediction using Deep Networks in Atari Gamescited by 171
  25. 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 164
  26. 2022Handling Distribution Shifts on Graphs: An Invariance Perspectivecited by 163
  27. 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
  28. 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
  29. 2022Uncertainty Modeling for Out-of-Distribution Generalizationcited by 122
  30. 2019PPINN: Parareal Physics-Informed Neural Network for time-dependent PDEscited by 116
  31. 2020A Review on Deep Learning Techniques for Video Predictioncited by 114
  32. 2021Towards a Theoretical Framework of Out-of-Distribution Generalizationcited by 94
  33. 2021CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Methodcited by 93
  34. 2022Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learningcited by 84
  35. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
  36. 2021Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codescited by 71
  37. 2023Discover and Cure: Concept-aware Mitigation of Spurious Correlationcited by 71
  38. 2018SOM-VAE: Interpretable Discrete Representation Learning on Time Seriescited by 59

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 3.

5 papers.