Frequency-Aware Vision Transformers for High-Fidelity Super-Resolution of Earth System Models
Not on the map. Why?
Abstract (arXiv)
Super-resolution can play an essential role in enhancing the spatial fidelity of Earth System Model outputs, allowing fine-scale structures highly beneficial to climate science to be recovered from coarse simulations. However, traditional deep super-resolution methods, including convolutional and transformer based models, tend to exhibit spectral bias, reconstructing low-frequency content more readily than valuable high-frequency details. In this work, we introduce ViSIR and ViFOR, two frequency-aware frameworks. ViSIR stands for the Vision Transformer-Tuned Sinusoidal Implicit Representation. ViSIR combines vision transformers with sinusoidal activations to mitigate spectral bias. ViFOR stands for the Vision Transformer Fourier Representation Network. ViFOR integrates explicit Fourier based filtering for independent low- and high-frequency learning. Evaluated on the E3SM-HR Earth system dataset across surface temperature, shortwave, and longwave fluxes, these models outperform leading Convolutional NN, Generative Networks, and vanilla transformer baselines, with ViFOR demonstrating up to 2.6~dB improvements in Peak Signal to Noise Ratio and higher Structural Similarity.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 44 references that are in the map. First posted on arXiv 18 Feb 2025.
Builds on
19 of 44 references.
References · 19
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
7 more
- 2017DeepSD: Generating High Resolution Climate Change Projections through Single Image Super-Resolutioncited by 80
- 2022Improving Vision Transformers by Revisiting High-frequency Componentscited by 75
- 2022Generalised Implicit Neural Representationscited by 31
- 2022Single Image Super-Resolution Methods: A Surveycited by 3
- 2023Generating High-Resolution Regional Precipitation Using Conditional Diffusion Modelcited by 3
- 2025NeurOp-Diff:Continuous Remote Sensing Image Super-Resolution via Neural Operator Diffusioncited by 3
- 2022A Novel End-To-End Network for Reconstruction of Non-Regularly Sampled Image Data Using Locally Fully Connected Layerscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.