Cross-Resolution Attention Network for High-Resolution PM2.5 Prediction
Not on the map. Why?
Abstract (arXiv)
Vision Transformers have achieved remarkable success in spatio-temporal prediction, but their scalability remains limited for ultra-high-resolution, continent-scale domains required in real-world environmental monitoring. A single European air-quality map at 1 km resolution comprises 29 million pixels, far beyond the limits of naive self-attention. We introduce CRAN-PM, a dual-branch Vision Transformer that leverages cross-resolution attention to efficiently fuse global meteorological data (25 km) with local high-resolution PM2.5 at the current time (1 km). Instead of including physically driven factors like temperature and topography as input, we further introduce elevation-aware self-attention and wind-guided cross-attention to force the network to learn physically consistent feature representations for PM2.5 forecasting. CRAN-PM is fully trainable and memory-efficient, generating the complete 29-million-pixel European map in 1.8 seconds on a single GPU. Evaluated on daily PM2.5 forecasting throughout Europe in 2022 (362 days, 2,971 European Environment Agency (EEA) stations), it reduces RMSE by 4.7% at T+1 and 10.7% at T+3 compared to the best single-scale baseline, while reducing bias in complex terrain by 36%.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 32 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
17 of 32 references.
References · 17
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
- 2021Video Swin Transformercited by 1,091
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
- 2023ClimaX: A foundation model for weather and climatecited by 337
- 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
- 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 195
5 more
- 2022SimVP: Simpler yet Better Video Predictioncited by 184
- 2022VPTR: Efficient Transformers for Video Predictioncited by 17
- 2024Neural Network Emulator for Atmospheric Chemical ODEcited by 5
- 2025Deep Spatio-Temporal Neural Network for Air Quality Reanalysiscited by 4
- 2026TopoFlow: Topography-aware Pollutant Flow Learning for High-Resolution Air Quality Predictioncited by 1
Built on by
Not cited yet.