Turb-L1: Achieving Long-term Turbulence Tracing By Tackling Spectral Bias
Not on the map. Why?
Abstract (arXiv)
Accurately predicting the long-term evolution of turbulence is crucial for advancing scientific understanding and optimizing engineering applications. However, existing deep learning methods face significant bottlenecks in long-term autoregressive prediction, which exhibit excessive smoothing and fail to accurately track complex fluid dynamics. Our extensive experimental and spectral analysis of prevailing methods provides an interpretable explanation for this shortcoming, identifying Spectral Bias as the core obstacle. Concretely, spectral bias is the inherent tendency of models to favor low-frequency, smooth features while overlooking critical high-frequency details during training, thus reducing fidelity and causing physical distortions in long-term predictions. Building on this insight, we propose Turb-L1, an innovative turbulence prediction method, which utilizes a Hierarchical Dynamics Synthesis mechanism within a multi-grid architecture to explicitly overcome spectral bias. It accurately captures cross-scale interactions and preserves the fidelity of high-frequency dynamics, enabling reliable long-term tracking of turbulence evolution. Extensive experiments on the 2D turbulence benchmark show that Turb-L1 demonstrates excellent performance: (I) In long-term predictions, it reduces Mean Squared Error (MSE) by 80.3% and increases Structural Similarity (SSIM) by over 9× compared to the SOTA baseline, significantly improving prediction fidelity. (II) It effectively overcomes spectral bias, accurately reproducing the full enstrophy spectrum and maintaining physical realism in high-wavenumber regions, thus avoiding the spectral distortions or spurious energy accumulation seen in other methods.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 32 of its 83 references that are in the map. First posted on arXiv 25 May 2025.
Builds on
32 of 83 references.
References · 32
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 947
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
20 more
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
- 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 569
- 2021Machine learning accelerated computational fluid dynamicscited by 471
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
- 2022How Do Vision Transformers Work?cited by 307
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 214
- 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 152
- 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 89
- 2024Neural Operators with Localized Integral and Differential Kernelscited by 62
- 2023PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Predictioncited by 44
- 2019MgNet: A Unified Framework of Multigrid and Convolutional Neural Networkcited by 41
- 2021Spectral Bias in Practice: The Role of Function Frequency in Generalizationcited by 37
- 2021On Measuring and Controlling the Spectral Bias of the Deep Image Priorcited by 36
- 2025OneForecast: A Universal Framework for Global and Regional Weather Forecastingcited by 34
- 2024Addressing Spectral Bias of Deep Neural Networks by Multi-Grade Deep Learningcited by 14
- 2024Modeling Spatio-temporal Dynamical Systems with Neural Discrete Learning and Levels-of-Expertscited by 9
- 2024Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidancecited by 5
- 2024BeamVQ: Aligning Space-Time Forecasting Model via Self-training on Physics-aware Metricscited by 3
Built on by
Citing papers per year: 2025: 7; 2026: 2.
9 papers.
- 2025Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecastingcited by 55
- 2025NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulationcited by 12
- 2025Breaking the Discretization Barrier of Continuous Physics Simulation Learningcited by 4
- 2025S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecastingcited by 2
- 2026OMNIFLOW: A Physics-Grounded Multimodal Agent for Generalized Scientific Reasoningcited by 2
- 2026PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecastingcited by 2
- 2025Learning from History: A Retrieval-Augmented Framework for Spatiotemporal Predictioncited by 1
- 2025DIFFUMA: High-Fidelity Spatio-Temporal Video Prediction via Dual-Path Mamba and Diffusion Enhancementcited by 0
- 2025VISION: Prompting Ocean Vertical Velocity Reconstruction from Incomplete Observationscited by 0
- 2026PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecasting9 May 2026
- 2026OMNIFLOW: A Physics-Grounded Multimodal Agent for Generalized Scientific Reasoning16 Mar 2026
- 2025S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecasting29 Nov 2025
- 2025Learning from History: A Retrieval-Augmented Framework for Spatiotemporal Prediction28 Oct 2025
- 2025VISION: Prompting Ocean Vertical Velocity Reconstruction from Incomplete Observations25 Sep 2025
- 2025Breaking the Discretization Barrier of Continuous Physics Simulation Learning22 Sep 2025
- 2025DIFFUMA: High-Fidelity Spatio-Temporal Video Prediction via Dual-Path Mamba and Diffusion Enhancement9 Jul 2025
- 2025Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting27 Jun 2025
- 2025NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulation27 May 2025