mlsanityData to 14 Oct 2026

Turb-L1: Achieving Long-term Turbulence Tracing By Tackling Spectral Bias

arXiv 2505.19038 ↗First posted 25 May 2025cs.LG cs.AI physics.flu-dyncited by 9

Not on the map. Why?

Abstract (arXiv)

Accurately predicting the long-term evolution of turbulence is crucial for advancing scientific understanding and optimizing engineering applications. However, existing deep learning methods face significant bottlenecks in long-term autoregressive prediction, which exhibit excessive smoothing and fail to accurately track complex fluid dynamics. Our extensive experimental and spectral analysis of prevailing methods provides an interpretable explanation for this shortcoming, identifying Spectral Bias as the core obstacle. Concretely, spectral bias is the inherent tendency of models to favor low-frequency, smooth features while overlooking critical high-frequency details during training, thus reducing fidelity and causing physical distortions in long-term predictions. Building on this insight, we propose Turb-L1, an innovative turbulence prediction method, which utilizes a Hierarchical Dynamics Synthesis mechanism within a multi-grid architecture to explicitly overcome spectral bias. It accurately captures cross-scale interactions and preserves the fidelity of high-frequency dynamics, enabling reliable long-term tracking of turbulence evolution. Extensive experiments on the 2D turbulence benchmark show that Turb-L1 demonstrates excellent performance: (I) In long-term predictions, it reduces Mean Squared Error (MSE) by 80.3% and increases Structural Similarity (SSIM) by over 9× compared to the SOTA baseline, significantly improving prediction fidelity. (II) It effectively overcomes spectral bias, accurately reproducing the full enstrophy spectrum and maintaining physical realism in high-wavenumber regions, thus avoiding the spectral distortions or spurious energy accumulation seen in other methods.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 32 of its 83 references that are in the map. First posted on arXiv 25 May 2025.

Builds on

32 of 83 references.

References · 32

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  7. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  8. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  9. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  10. 2018On the Spectral Bias of Neural Networkscited by 1,341
  11. 2021CvT: Introducing Convolutions to Vision Transformerscited by 947
  12. 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
20 more
  1. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  2. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
  3. 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 569
  4. 2021Machine learning accelerated computational fluid dynamicscited by 471
  5. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
  6. 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
  7. 2022How Do Vision Transformers Work?cited by 307
  8. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
  9. 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 152
  10. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 89
  11. 2024Neural Operators with Localized Integral and Differential Kernelscited by 62
  12. 2023PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Predictioncited by 44
  13. 2019MgNet: A Unified Framework of Multigrid and Convolutional Neural Networkcited by 41
  14. 2021Spectral Bias in Practice: The Role of Function Frequency in Generalizationcited by 37
  15. 2021On Measuring and Controlling the Spectral Bias of the Deep Image Priorcited by 36
  16. 2025OneForecast: A Universal Framework for Global and Regional Weather Forecastingcited by 34
  17. 2024Addressing Spectral Bias of Deep Neural Networks by Multi-Grade Deep Learningcited by 14
  18. 2024Modeling Spatio-temporal Dynamical Systems with Neural Discrete Learning and Levels-of-Expertscited by 9
  19. 2024Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidancecited by 5
  20. 2024BeamVQ: Aligning Space-Time Forecasting Model via Self-training on Physics-aware Metricscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 2.

9 papers.