PEST: Physics-Enhanced Swin Transformer for 3D Turbulence Simulation
Not on the map. Why?
Abstract (arXiv)
Accurate simulation of turbulent flows is fundamental to scientific and engineering applications. Direct numerical simulation (DNS) offers the highest fidelity but is computationally prohibitive, while existing data-driven alternatives struggle with stable long-horizon rollouts, physical consistency, and faithful simulation of small-scale structures. These challenges are particularly acute in three-dimensional (3D) settings, where the cubic growth of spatial degrees of freedom dramatically amplifies computational cost, memory demand, and the difficulty of capturing multi-scale interactions. To address these challenges, we propose a Physics-Enhanced Swin Transformer (PEST) for 3D turbulence simulation. PEST leverages a window-based self-attention mechanism to effectively model localized PDE interactions while maintaining computational efficiency. We introduce a frequency-domain adaptive loss that explicitly emphasizes small-scale structures, enabling more faithful simulation of high-frequency dynamics. To improve physical consistency, we incorporate Navier--Stokes residual constraints and divergence-free regularization directly into the learning objective. Extensive experiments on two representative turbulent flow configurations demonstrate that PEST achieves accurate, physically consistent, and stable autoregressive long-term simulations, outperforming existing data-driven baselines.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 17 of its 44 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
17 of 44 references.
References · 17
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2021Machine learning accelerated computational fluid dynamicscited by 461
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
- 2020hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decompositioncited by 236
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 205
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
- 2021Multi-Objective Loss Balancing for Physics-Informed Deep Learningcited by 86
5 more
- 2023Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEscited by 66
- 2017Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High-Resolution Simulationscited by 51
- 2025FreqMoE: Dynamic Frequency Enhancement for Neural PDE Solverscited by 6
- 2026Learning PDE Solvers with Physics and Data: A Unifying View of Physics-Informed Neural Networks and Neural Operatorscited by 6
- 2024Accelerate Coastal Ocean Circulation Model with AI Surrogatecited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Flow Learners for PDEs: Toward a Physics-to-Physics Paradigm for Scientific Computingcited by 4
- 2026FlowRefiner: Flow Matching-Based Iterative Refinement for 3D Turbulent Flow Simulationcited by 4
- 2026Physics-Preserving Latent Compression for Zero-Shot Resolution Transfer in 3D Turbulencecited by 2
- 2026TIDE: A Physically Diverse 3D Turbulence Benchmark Dataset for Advancing Scientific Machine Learningcited by 1
- 2026Staying on the Attractor: Supervising Neural Surrogates of 3D Turbulence Where They Leave Itcited by 0
- 2026Staying on the Attractor: Supervising Neural Surrogates of 3D Turbulence Where They Leave It26 Sep 2026
- 2026TIDE: A Physically Diverse 3D Turbulence Benchmark Dataset for Advancing Scientific Machine Learning4 Aug 2026
- 2026Physics-Preserving Latent Compression for Zero-Shot Resolution Transfer in 3D Turbulence19 Jun 2026
- 2026FlowRefiner: Flow Matching-Based Iterative Refinement for 3D Turbulent Flow Simulation18 Apr 2026
- 2026Flow Learners for PDEs: Toward a Physics-to-Physics Paradigm for Scientific Computing2 Apr 2026