DynamicVis: Dynamic Visual Perception for Efficient Remote Sensing Foundation Models
Not on the map. Why?
Abstract (arXiv)
The advancement of RS technology has enabled high-resolution Earth observation; however, interpreting these images using modern VFMs remains a significant challenge. Unlike object-centric natural images, RS imagery is fundamentally characterized by extreme target sparsity and massive spatial redundancy. Key objects of interest (e.g., ships, vehicles) often occupy less than 1% of the spatial extent, surrounded by vast, target-free backgrounds. Existing VFMs predominantly rely on uniform dense processing (e.g., ViTs) and pixel-reconstruction pre-training paradigms (e.g., MAE). These approaches inherently waste substantial computational capacity on modeling redundant backgrounds and inadvertently dilute the feature representations of small, sparse targets. To bridge this structural misalignment, we propose DynamicVis, a visual foundation model explicitly tailored to the sparse nature of RS imagery. Architecturally, DynamicVis introduces a Dynamic Region-Aware SSM that bypasses uniform computation. It adaptively routes and incrementally models only task-relevant, high-salience tokens while employing a parameter-free integration for background context, drastically reducing the complexity of processing ultra-long 2D token sequences (~100,000). Crucially, to equip the network with robust spatial-selection capabilities, we propose a novel Region-Level Meta-Embedding Multi-Instance Learning (MIL) pre-training paradigm. Trained on a million-scale dataset, this paradigm explicitly disentangles sparse foreground instances from dense backgrounds in the latent semantic space, overcoming the semantic ambiguity of conventional pixel-reconstruction methods. Extensive evaluations across nine diverse downstream tasks reveal that DynamicVis exhibits exceptional efficacy, particularly dominating in sparse-target and instance-level perception tasks (e.g., small object detection, and change detection).
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 71 of its 156 references that are in the map. First posted on arXiv 20 Mar 2025.
Builds on
71 of 156 references.
References · 71
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2023Segment Anythingcited by 8,234
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017Mask R-CNNcited by 7,277
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
38 more
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2018YOLOv3: An Incremental Improvementcited by 2,659
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2019Objects as Pointscited by 1,175
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
- 2022Token Merging: Your ViT But Fastercited by 1,021
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
- 2018Dual Attention Network for Scene Segmentationcited by 1,003
- 2024VMamba: Visual State Space Modelcited by 969
- 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 864
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 616
- 2022Vision Transformer Adapter for Dense Predictionscited by 565
- 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
- 2020Sparse R-CNN: End-to-End Object Detection with Learnable Proposalscited by 495
- 2019Hybrid Task Cascade for Instance Segmentationcited by 481
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
- 2017Functional Map of the Worldcited by 338
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
- 2020Conditional Convolutions for Instance Segmentationcited by 314
- 2018Fully Convolutional Siamese Networks for Change Detectioncited by 306
- 2021Remote Sensing Image Change Detection with Transformerscited by 306
- 2019Mask Scoring R-CNNcited by 266
- 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
- 2022A Transformer-Based Siamese Network for Change Detectioncited by 244
- 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 204
- 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectorscited by 195
- 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 181
- 2020FCOS: A simple and strong anchor-free object detectorcited by 171
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
- 2019Scale-Aware Trident Networks for Object Detectioncited by 159
- 2020BoxInst: High-Performance Instance Segmentation with Box Annotationscited by 151
50 most cited of 71 All 71 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025GeoViS: Geospatially Rewarded Visual Search for Remote Sensing Visual Grounding
- 2025RSRWKV: A Linear-Complexity 2D Attention Mechanism for Efficient Remote Sensing Vision Task
- 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Grounding
- 2026A Controlled Benchmark of Visual State-Space Backbones with Domain-Shift and Boundary Analysis for Remote-Sensing Segmentation
- 2026GeoVista: Visually Grounded Active Perception for Vision-Language Understanding of Ultra-High-Resolution Remote Sensing Images
- 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos
- 2026Aperture: Training-Free Multiscale Concept Bottlenecks for Remote Sensing
- 2025DOFA-CLIP: Multimodal Vision-Language Foundation Models for Earth Observation