mlsanityData to 7 Oct 2026

RSRWKV: A Linear-Complexity 2D Attention Mechanism for Efficient Remote Sensing Vision Task

arXiv 2503.20382 ↗First posted 26 Mar 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

High-resolution remote sensing analysis faces challenges in global context modeling due to scene complexity and scale diversity. While CNNs excel at local feature extraction via parameter sharing, their fixed receptive fields fundamentally restrict long-range dependency modeling. Vision Transformers (ViTs) effectively capture global semantic relationships through self-attention mechanisms but suffer from quadratic computational complexity relative to image resolution, creating critical efficiency bottlenecks for high-resolution imagery. The RWKV model's linear-complexity sequence modeling achieves breakthroughs in NLP but exhibits anisotropic limitations in vision tasks due to its 1D scanning mechanism. To address these challenges, we propose RSRWKV, featuring a novel 2D-WKV scanning mechanism that bridges sequential processing and 2D spatial reasoning while maintaining linear complexity. This enables isotropic context aggregation across multiple directions. The MVC-Shift module enhances multi-scale receptive field coverage, while the ECA module strengthens cross-channel feature interaction and semantic saliency modeling. Experimental results demonstrate RSRWKV's superior performance over CNN and Transformer baselines in classification, detection, and segmentation tasks on NWPU RESISC45, VHR-10.v2, and GLH-Water datasets, offering a scalable solution for high-resolution remote sensing analysis.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 65 references that are in the map. First posted on arXiv 26 Mar 2025.

Builds on

45 of 65 references.

References · 45

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  6. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  7. 2016Layer Normalizationcited by 5,579
  8. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  9. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  10. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  11. 2016Pyramid Scene Parsing Networkcited by 2,472
  12. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
33 more
  1. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
  2. 2020Rethinking Attention with Performerscited by 1,584
  3. 2017Deformable Convolutional Networkscited by 1,481
  4. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
  5. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
  6. 2024VMamba: Visual State Space Modelcited by 955
  7. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 814
  8. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
  9. 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 594
  10. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 572
  11. 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
  12. 2022Vision Transformer Adapter for Dense Predictionscited by 564
  13. 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 490
  14. 2019ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed datacited by 260
  15. 2018Gather-Excite: Exploiting Feature Context in Convolutional Neural Networkscited by 138
  16. 2024Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architecturescited by 97
  17. 2024RSMamba: Remote Sensing Image Classification with State Space Modelcited by 95
  18. 2023RMT: Retentive Networks Meet Vision Transformerscited by 68
  19. 2022Transformers in Remote Sensing: A Surveycited by 61
  20. 2023TransNeXt: Robust Foveal Visual Perception for Vision Transformerscited by 61
  21. 2024Rewrite the Starscited by 55
  22. 2023Scale-Aware Modulation Meet Transformercited by 49
  23. 2019In-domain representation learning for remote sensingcited by 41
  24. 2024Diffusion-RWKV: Scaling RWKV-Like Architectures for Diffusion Modelscited by 41
  25. 2024Restore-RWKV: Efficient and Effective Medical Image Restoration with RWKVcited by 36
  26. 2024RWKV-CLIP: A Robust Vision-Language Representation Learnercited by 23
  27. 2024PointRWKV: Efficient RWKV-Like Model for Hierarchical Point Cloud Learningcited by 21
  28. 2024Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Modelcited by 18
  29. 2024Deform-Mamba Network for MRI Super-Resolutioncited by 17
  30. 2023GLH-Water: A Large-Scale Dataset for Global Surface Water Detection in Large-Size Very-High-Resolution Satellite Imagerycited by 16
  31. 2022Comparing the Decision-Making Mechanisms by Transformers and CNNs via Explanation Methodscited by 12
  32. 2024OrientedFormer: An End-to-End Transformer-Based Oriented Object Detector in Remote Sensing Imagescited by 10
  33. 2025LWGANet: Addressing Spatial and Channel Redundancy in Remote Sensing Visual Tasks with Light-Weight Grouped Attentioncited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs
  2. 2026RRS-10K: A Multitask Vision-Language Model Benchmark for Rare Remote Sensing Image Interpretation
  3. 2026SkyNative: A Native Multimodal Architecture for Remote Sensing Vision-Language Understanding
  4. 2026Continual Vision-Language Learning for Remote Sensing: Benchmarking and Analysis
  5. 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model
  6. 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
  7. 2024RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Experts
  8. 2025GeoMag: A Vision-Language Model for Pixel-level Fine-Grained Remote Sensing Image Parsing