RSRWKV: A Linear-Complexity 2D Attention Mechanism for Efficient Remote Sensing Vision Task
Not on the map. Why?
Abstract (arXiv)
High-resolution remote sensing analysis faces challenges in global context modeling due to scene complexity and scale diversity. While CNNs excel at local feature extraction via parameter sharing, their fixed receptive fields fundamentally restrict long-range dependency modeling. Vision Transformers (ViTs) effectively capture global semantic relationships through self-attention mechanisms but suffer from quadratic computational complexity relative to image resolution, creating critical efficiency bottlenecks for high-resolution imagery. The RWKV model's linear-complexity sequence modeling achieves breakthroughs in NLP but exhibits anisotropic limitations in vision tasks due to its 1D scanning mechanism. To address these challenges, we propose RSRWKV, featuring a novel 2D-WKV scanning mechanism that bridges sequential processing and 2D spatial reasoning while maintaining linear complexity. This enables isotropic context aggregation across multiple directions. The MVC-Shift module enhances multi-scale receptive field coverage, while the ECA module strengthens cross-channel feature interaction and semantic saliency modeling. Experimental results demonstrate RSRWKV's superior performance over CNN and Transformer baselines in classification, detection, and segmentation tasks on NWPU RESISC45, VHR-10.v2, and GLH-Water datasets, offering a scalable solution for high-resolution remote sensing analysis.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 65 references that are in the map. First posted on arXiv 26 Mar 2025.
Builds on
45 of 65 references.
References · 45
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2016Layer Normalizationcited by 5,579
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
33 more
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
- 2020Rethinking Attention with Performerscited by 1,584
- 2017Deformable Convolutional Networkscited by 1,481
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
- 2024VMamba: Visual State Space Modelcited by 955
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 814
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
- 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 594
- 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 572
- 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 490
- 2019ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed datacited by 260
- 2018Gather-Excite: Exploiting Feature Context in Convolutional Neural Networkscited by 138
- 2024Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architecturescited by 97
- 2024RSMamba: Remote Sensing Image Classification with State Space Modelcited by 95
- 2023RMT: Retentive Networks Meet Vision Transformerscited by 68
- 2022Transformers in Remote Sensing: A Surveycited by 61
- 2023TransNeXt: Robust Foveal Visual Perception for Vision Transformerscited by 61
- 2024Rewrite the Starscited by 55
- 2023Scale-Aware Modulation Meet Transformercited by 49
- 2019In-domain representation learning for remote sensingcited by 41
- 2024Diffusion-RWKV: Scaling RWKV-Like Architectures for Diffusion Modelscited by 41
- 2024Restore-RWKV: Efficient and Effective Medical Image Restoration with RWKVcited by 36
- 2024RWKV-CLIP: A Robust Vision-Language Representation Learnercited by 23
- 2024PointRWKV: Efficient RWKV-Like Model for Hierarchical Point Cloud Learningcited by 21
- 2024Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Modelcited by 18
- 2024Deform-Mamba Network for MRI Super-Resolutioncited by 17
- 2023GLH-Water: A Large-Scale Dataset for Global Surface Water Detection in Large-Size Very-High-Resolution Satellite Imagerycited by 16
- 2022Comparing the Decision-Making Mechanisms by Transformers and CNNs via Explanation Methodscited by 12
- 2024OrientedFormer: An End-to-End Transformer-Based Oriented Object Detector in Remote Sensing Imagescited by 10
- 2025LWGANet: Addressing Spatial and Channel Redundancy in Remote Sensing Visual Tasks with Light-Weight Grouped Attentioncited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs
- 2026RRS-10K: A Multitask Vision-Language Model Benchmark for Rare Remote Sensing Image Interpretation
- 2026SkyNative: A Native Multimodal Architecture for Remote Sensing Vision-Language Understanding
- 2026Continual Vision-Language Learning for Remote Sensing: Benchmarking and Analysis
- 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
- 2024RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Experts
- 2025GeoMag: A Vision-Language Model for Pixel-level Fine-Grained Remote Sensing Image Parsing