UniEvo-RS: Omni-Prompt Unified Remote Sensing Segmentation with Representative Exemplar-Driven Prototype Evolution
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Prompt-driven vision-language models (VLMs) hold immense promise for accelerating dense remote sensing (RS) annotation, but static models suffer from severe performance degradation when deployed on novel scenes, unseen categories, or visually confusing backgrounds. Moreover, existing unified paradigms primarily rely on intra-image specific prompts, lacking flexible task routing to adapt to multi-intent operational workflows. In practical batch mapping, annotators typically refine a small set of representative samples before processing large datasets. Motivated by this practice, we propose UniEvo-RS, an omni-prompt unified RS segmentation framework equipped with representative exemplar-driven prototype evolution. First, we construct a multi-instruction prompt dataset that unifies text-driven and visual-driven prompts within a single architecture, establishing a dynamic task-routing mechanism for highly diverse RS annotation scenarios. Second, we introduce a representative feedback-driven, training-free prototype evolution mechanism. By contrasting manual annotations with initial predictions on exemplars, UniEvo-RS distills prediction errors into positive and negative prototypes. These prototypes enhance LLM query recall and suppress spatial background noise under a fixed-budget clustering memory. Extensive experiments show that UniEvo-RS unifies diverse prompting tasks, achieving state-of-the-art performance across most settings. Crucially, with minimal interaction on a few exemplars, it enables training-free, progressive accuracy enhancement on unseen categories during batch annotation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 21 of its 34 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
21 of 34 references.
Closest ancestors · 2
Same direction, newest first
- 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensing18 Jul
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
Other references · 19
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 719
- 2022Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Taskscited by 421
- 2023Towards Stable Test-Time Adaptation in Dynamic Wild Worldcited by 415
- 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 318
- 2022Generalized Decoding for Pixel, Image, and Languagecited by 294
- 2019iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Imagescited by 197
- 2023Robust Test-Time Adaptation in Dynamic Scenarioscited by 189
7 more
- 2024PSALM: Pixelwise SegmentAtion with Large Multi-Modal Modelcited by 101
- 2022UViM: A Unified Modeling Approach for Vision with Learned Guiding Codescited by 78
- 2023Visual In-Context Promptingcited by 52
- 2025RemoteSAM: Towards Segment Anything for Earth Observationcited by 39
- 2025X-SAM: From Segment Anything to Any Segmentationcited by 30
- 2025UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenescited by 10
- 2025Omni-Referring Image Segmentationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Annotation-Free Open-Vocabulary Segmentation for Remote-Sensing Images
- 2026Prompt-Calibrated SAM 3 for Open-Vocabulary Remote Sensing Semantic Segmentation
- 2026Enabling Training-Free Text-Based Remote Sensing Segmentation
- 2026Omni-RS: Unifying Multi-Task Understanding and Generation in Remote Sensing
- 2026VPRef: A Cross-Domain Benchmark for Referring Remote Sensing Image Segmentation
- 2026SatOV: Restoring Spatial Priors for Training-Free Open-Vocabulary Segmentation in Remote Sensing Imagery
- 2025Few-Shot Remote Sensing Image Scene Classification with CLIP and Prompt Learning
- 2026ConInfer: Context-Aware Inference for Training-Free Open-Vocabulary Remote Sensing Segmentation