mlsanityData to 14 Oct 2026

DynamicVis: Dynamic Visual Perception for Efficient Remote Sensing Foundation Models

arXiv 2503.16426 ↗First posted 20 Mar 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

The advancement of RS technology has enabled high-resolution Earth observation; however, interpreting these images using modern VFMs remains a significant challenge. Unlike object-centric natural images, RS imagery is fundamentally characterized by extreme target sparsity and massive spatial redundancy. Key objects of interest (e.g., ships, vehicles) often occupy less than 1% of the spatial extent, surrounded by vast, target-free backgrounds. Existing VFMs predominantly rely on uniform dense processing (e.g., ViTs) and pixel-reconstruction pre-training paradigms (e.g., MAE). These approaches inherently waste substantial computational capacity on modeling redundant backgrounds and inadvertently dilute the feature representations of small, sparse targets. To bridge this structural misalignment, we propose DynamicVis, a visual foundation model explicitly tailored to the sparse nature of RS imagery. Architecturally, DynamicVis introduces a Dynamic Region-Aware SSM that bypasses uniform computation. It adaptively routes and incrementally models only task-relevant, high-salience tokens while employing a parameter-free integration for background context, drastically reducing the complexity of processing ultra-long 2D token sequences (~100,000). Crucially, to equip the network with robust spatial-selection capabilities, we propose a novel Region-Level Meta-Embedding Multi-Instance Learning (MIL) pre-training paradigm. Trained on a million-scale dataset, this paradigm explicitly disentangles sparse foreground instances from dense backgrounds in the latent semantic space, overcoming the semantic ambiguity of conventional pixel-reconstruction methods. Extensive evaluations across nine diverse downstream tasks reveal that DynamicVis exhibits exceptional efficacy, particularly dominating in sparse-target and instance-level perception tasks (e.g., small object detection, and change detection).

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 71 of its 156 references that are in the map. First posted on arXiv 20 Mar 2025.

Builds on

71 of 156 references.

References · 71

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  5. 2023Segment Anythingcited by 8,234
  6. 2020End-to-End Object Detection with Transformerscited by 7,414
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  8. 2017Mask R-CNNcited by 7,277
  9. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  10. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  11. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  12. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
38 more
  1. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  2. 2018YOLOv3: An Incremental Improvementcited by 2,659
  3. 2016Pyramid Scene Parsing Networkcited by 2,479
  4. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
  5. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
  6. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
  7. 2019Objects as Pointscited by 1,175
  8. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
  9. 2022Token Merging: Your ViT But Fastercited by 1,021
  10. 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
  11. 2018Dual Attention Network for Scene Segmentationcited by 1,003
  12. 2024VMamba: Visual State Space Modelcited by 969
  13. 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 864
  14. 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 616
  15. 2022Vision Transformer Adapter for Dense Predictionscited by 565
  16. 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
  17. 2020Sparse R-CNN: End-to-End Object Detection with Learnable Proposalscited by 495
  18. 2019Hybrid Task Cascade for Instance Segmentationcited by 481
  19. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
  20. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
  21. 2017Functional Map of the Worldcited by 338
  22. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
  23. 2020Conditional Convolutions for Instance Segmentationcited by 314
  24. 2018Fully Convolutional Siamese Networks for Change Detectioncited by 306
  25. 2021Remote Sensing Image Change Detection with Transformerscited by 306
  26. 2019Mask Scoring R-CNNcited by 266
  27. 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
  28. 2022A Transformer-Based Siamese Network for Change Detectioncited by 244
  29. 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
  30. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
  31. 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 204
  32. 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectorscited by 195
  33. 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 181
  34. 2020FCOS: A simple and strong anchor-free object detectorcited by 171
  35. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
  36. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
  37. 2019Scale-Aware Trident Networks for Object Detectioncited by 159
  38. 2020BoxInst: High-Performance Instance Segmentation with Box Annotationscited by 151

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025GeoViS: Geospatially Rewarded Visual Search for Remote Sensing Visual Grounding
  2. 2025RSRWKV: A Linear-Complexity 2D Attention Mechanism for Efficient Remote Sensing Vision Task
  3. 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Grounding
  4. 2026A Controlled Benchmark of Visual State-Space Backbones with Domain-Shift and Boundary Analysis for Remote-Sensing Segmentation
  5. 2026GeoVista: Visually Grounded Active Perception for Vision-Language Understanding of Ultra-High-Resolution Remote Sensing Images
  6. 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos
  7. 2026Aperture: Training-Free Multiscale Concept Bottlenecks for Remote Sensing
  8. 2025DOFA-CLIP: Multimodal Vision-Language Foundation Models for Earth Observation