HIMOSA: Efficient Remote Sensing Image Super-Resolution with Hierarchical Mixture of Sparse Attention
Not on the map. Why?
Abstract (arXiv)
In remote sensing applications, such as disaster detection and response, real-time efficiency and model lightweighting are of critical importance. Consequently, existing remote sensing image super-resolution methods often face a trade-off between model performance and computational efficiency. In this paper, we propose a lightweight super-resolution framework for remote sensing imagery, named HIMOSA. Specifically, HIMOSA leverages the inherent redundancy in remote sensing imagery and introduces a content-aware sparse attention mechanism, enabling the model to achieve fast inference while maintaining strong reconstruction performance. Furthermore, to effectively leverage the multi-scale repetitive patterns found in remote sensing imagery, we introduce a hierarchical window expansion and reduce the computational complexity by adjusting the sparsity of the attention. Extensive experiments on multiple remote sensing datasets demonstrate that our method achieves state-of-the-art performance while maintaining computational efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 53 references that are in the map. First posted on arXiv 29 Nov 2025.
Builds on
45 of 53 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
33 more
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
- 2020Pre-Trained Image Processing Transformercited by 893
- 2018Residual Dense Network for Image Super-Resolutioncited by 799
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
- 2022Mixture-of-Experts with Expert Choice Routingcited by 623
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 438
- 2025Muon is Scalable for LLM Trainingcited by 428
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 347
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 340
- 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
- 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
- 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 205
- 2020Interpreting Super-Resolution Networks with Local Attribution Mapscited by 136
- 2022Cross Aggregation Transformer for Image Restorationcited by 92
- 2022Accurate Image Restoration with Attention Retractable Transformercited by 85
- 2022SwinFIR: Revisiting the SwinIR with Fast Fourier Convolution and Improved Training for Image Super-Resolutioncited by 68
- 2021KVT: k-NN Attention for Boosting Vision Transformerscited by 65
- 2024Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionarycited by 64
- 2019Explicit Sparse Transformer: Concentrated Attention Through Explicit Selectioncited by 62
- 2023TransNeXt: Robust Foveal Visual Perception for Vision Transformerscited by 61
- 2024HiT-SR: Hierarchical Transformer for Efficient Image Super-Resolutioncited by 42
- 2023SwitchHead: Accelerating Transformers with Mixture-of-Experts Attentioncited by 34
- 2025Progressive Focused Transformer for Single Image Super-Resolutioncited by 25
- 2024See More Details: Efficient Image Super-Resolution by Experts Miningcited by 23
- 2022Enriched CNN-Transformer Feature Aggregation Networks for Super-Resolutioncited by 22
- 2025CATANet: Efficient Content-Aware Token Aggregation for Lightweight Image Super-Resolutioncited by 16
- 2025Mixture of Sparse Attention: Content-Based Learnable Sparse Attention via Expert-Choice Routingcited by 14
- 2024Interpreting Low-level Vision Models with Causal Effect Mapscited by 8
- 2025StereoINR: Cross-View Geometry Consistent Stereo Super Resolution with Implicit Neural Representationcited by 3
Built on by
Not cited yet.