Breaking Scale Anchoring: Frequency Representation Learning for Accurate High-Resolution Inference from Low-Resolution Training
Not on the map. Why?
Abstract (arXiv)
Zero-Shot Super-Resolution Spatiotemporal Forecasting requires a deep learning model to be trained on low-resolution data and deployed for inference on high-resolution. Existing studies consider maintaining similar error across different resolutions as indicative of successful multi-resolution generalization. However, deep learning models serving as alternatives to numerical solvers should reduce error as resolution increases. The fundamental limitation is, the upper bound of physical law frequencies that low-resolution data can represent is constrained by its Nyquist frequency, making it difficult for models to process signals containing unseen frequency components during high-resolution inference. This results in errors being anchored at low resolution, incorrectly interpreted as successful generalization. We define this fundamental phenomenon as a new problem distinct from existing issues: Scale Anchoring. Therefore, we propose architecture-agnostic Frequency Representation Learning. It alleviates Scale Anchoring through resolution-aligned frequency representations and spectral consistency training: on grids with higher Nyquist frequencies, the frequency response in high-frequency bands of FRL-enhanced variants is more stable. This allows errors to decrease with resolution and significantly outperform baselines within our task and resolution range, while incurring only modest computational overhead.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 53 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
38 of 53 references.
References · 38
- 2017Attention Is All You Needcited by 60,361
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
26 more
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 297
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
- 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Modelscited by 128
- 2023DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecastingcited by 109
- 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 82
- 2023Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEscited by 68
- 2023Representation Equivalent Neural Operators: a Framework for Alias-free Operator Learningcited by 57
- 2021Learning to Resize Images for Computer Vision Taskscited by 45
- 2022Mitigating spectral bias for the multiscale operator learningcited by 44
- 2022ResFormer: Scaling ViTs with Multi-Resolution Trainingcited by 34
- 2022ByteTransformer: A High-Performance Transformer Boosted for Variable-Length Inputscited by 32
- 2024Probabilistic Weather Forecasting with Hierarchical Graph Neural Networkscited by 30
- 2024A survey of dynamic graph neural networkscited by 24
- 2024Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modelingcited by 23
- 2024Discretization Error of Fourier Neural Operatorscited by 22
- 2020PDE-Driven Spatiotemporal Disentanglementcited by 19
- 2024Neural SPH: Improved Neural Modeling of Lagrangian Fluid Dynamicscited by 11
- 2024Spectral-Refiner: Accurate Fine-Tuning of Spatiotemporal Fourier Neural Operator for Turbulent Flowscited by 11
- 2024PARCv2: Physics-aware Recurrent Convolutional Neural Networks for Spatiotemporal Dynamics Modelingcited by 10
- 2024Scalable Spatiotemporal Prediction with Bayesian Neural Fieldscited by 10
- 2024NeuralFluid: Neural Fluidic System Design and Control with Differentiable Simulationcited by 10
- 2024From Fourier to Neural ODEs: Flow Matching for Modeling Complex Systemscited by 9
- 2021Interpretable Data-driven Methods for Subgrid-scale Closure in LES for Transcritical LOX/GCH4 Combustioncited by 6
- 2024DeepLag: Discovering Deep Lagrangian Dynamics for Intuitive Fluid Predictioncited by 3
- 2024Fourier neural operators for spatiotemporal dynamics in two-dimensional turbulencecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.