Composed Image Retrieval for Remote Sensing
Not on the map. Why?
Abstract (arXiv)
This work introduces composed image retrieval to remote sensing. It allows to query a large image archive by image examples alternated by a textual description, enriching the descriptive power over unimodal queries, either visual or textual. Various attributes can be modified by the textual part, such as shape, color, or context. A novel method fusing image-to-image and text-to-image similarity is introduced. We demonstrate that a vision-language model possesses sufficient descriptive power and no further learning step or training data are necessary. We present a new evaluation benchmark focused on color, context, density, existence, quantity, and shape modifications. Our work not only sets the state-of-the-art for this task, but also serves as a foundational step in addressing a gap in the field of remote sensing image retrieval. Code at: https://github.com/billpsomas/rscir
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 38 of its 98 references that are in the map. First posted on arXiv 24 May 2024.
Builds on
38 of 98 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 906
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
- 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 565
- 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 499
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
26 more
- 2016Large-Scale Image Retrieval with Attentive Deep Local Featurescited by 238
- 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 236
- 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 176
- 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 156
- 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 151
- 2021ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmeticcited by 150
- 2016Deep Image Retrieval: Learning global representations for image searchcited by 147
- 2017Automatic Spatially-aware Fashion Concept Discoverycited by 134
- 2020Disentangled Non-Local Neural Networkscited by 132
- 2023Vision-by-Language for Training-Free Compositional Image Retrievalcited by 103
- 2017PatternNet: A Benchmark Dataset for Performance Evaluation of Remote Sensing Image Retrievalcited by 97
- 2021BigEarthNet-MM: A Large Scale Multi-Modal Multi-Label Benchmark Archive for Remote Sensing Image Classification and Retrievalcited by 92
- 2022Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Imagecited by 88
- 2022ARTEMIS: Attention-based Retrieval with Text-Explicit Matching and Implicit Similaritycited by 83
- 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
- 2019Adversarial Representation Learning for Text-to-Image Matchingcited by 65
- 2022Remote Sensing Cross-Modal Text-Image Retrieval Based on Global and Local Informationcited by 40
- 2022Probabilistic Compositional Embeddings for Multimodal Image Retrievalcited by 29
- 2022Geo-Localization via Ground-to-Satellite Cross-View Image Retrievalcited by 16
- 2019Enhancing Remote Sensing Image Retrieval with Triplet Deep Metric Learning Networkcited by 12
- 2021Informative and Representative Triplet Selection for Multilabel Remote Sensing Image Retrievalcited by 9
- 2021A Novel Graph-Theoretic Deep Representation Learning Method for Multi-Label Remote Sensing Image Retrievalcited by 7
- 2016Visual descriptors for content-based retrieval of remote sensing imagescited by 6
- 2016Learning Low Dimensional Convolutional Neural Networks for High-Resolution Remote Sensing Image Retrievalcited by 6
- 2019Aggregated Deep Local Features for Remote Sensing Image Retrievalcited by 5
- 2020Cross-View Image Retrieval -- Ground to Aerial Image Retrieval through Deep Learningcited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 11; 2026: 2.
14 papers.
Sort:
By area:
- 2025CoLLM: A Large Language Model for Composed Image Retrievalcited by 21
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2025A Comprehensive Survey on Composed Image Retrievalcited by 17
- 2025Instance-Level Composed Image Retrievalcited by 12
- 2025OASIS: Online Sample Selection for Continual Visual Instruction Tuningcited by 9
- 2025ConText-CIR: Learning from Concepts in Text for Composed Image Retrievalcited by 7
- 2024Composed Image Retrieval for Training-Free Domain Conversioncited by 4
- 2025good4cir: Generating Detailed Synthetic Captions for Composed Image Retrievalcited by 4
- 2025Composed Multi-modal Retrieval: A Survey of Approaches and Applicationscited by 2
- 2025FIGROTD: A Friendly-to-Handle Dataset for Image Guided Retrieval with Optional Textcited by 1
- 2025VLM2GeoVec: Toward Universal Multimodal Embeddings for Remote Sensingcited by 0
- 2025An Efficient and Effective Encoder Model for Vision and Language Tasks in the Remote Sensing Domaincited by 0
- 2026Benchmarking Composed Image Retrieval for Applied Earth Observation23 May 2026
- 2026Decoupling Endpoint and Semantic Transition Learning for Zero-Shot Composed Image Retrieval8 May 2026
- 2025An Efficient and Effective Encoder Model for Vision and Language Tasks in the Remote Sensing Domain17 Dec 2025
- 2025VLM2GeoVec: Toward Universal Multimodal Embeddings for Remote Sensing12 Dec 2025
- 2025FIGROTD: A Friendly-to-Handle Dataset for Image Guided Retrieval with Optional Text27 Nov 2025
- 2025Instance-Level Composed Image Retrieval29 Oct 2025
- 2025OASIS: Online Sample Selection for Continual Visual Instruction Tuning27 May 2025
- 2025ConText-CIR: Learning from Concepts in Text for Composed Image Retrieval27 May 2025
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May 2025
- 2025CoLLM: A Large Language Model for Composed Image Retrieval25 Mar 2025
- 2025good4cir: Generating Detailed Synthetic Captions for Composed Image Retrieval22 Mar 2025
- 2025Composed Multi-modal Retrieval: A Survey of Approaches and Applications3 Mar 2025
2 more
- 2025A Comprehensive Survey on Composed Image Retrieval19 Feb 2025
- 2024Composed Image Retrieval for Training-Free Domain Conversion4 Dec 2024
- 2025CoLLM: A Large Language Model for Composed Image Retrievalcited by 21
- 2025A Comprehensive Survey on Composed Image Retrievalcited by 17
- 2025Instance-Level Composed Image Retrievalcited by 12
- 2025OASIS: Online Sample Selection for Continual Visual Instruction Tuningcited by 9
- 2025ConText-CIR: Learning from Concepts in Text for Composed Image Retrievalcited by 7
- 2024Composed Image Retrieval for Training-Free Domain Conversioncited by 4
- 2025Composed Multi-modal Retrieval: A Survey of Approaches and Applicationscited by 2
- 2025FIGROTD: A Friendly-to-Handle Dataset for Image Guided Retrieval with Optional Textcited by 1
- 2025VLM2GeoVec: Toward Universal Multimodal Embeddings for Remote Sensingcited by 0
- 2025An Efficient and Effective Encoder Model for Vision and Language Tasks in the Remote Sensing Domaincited by 0
- 2026Decoupling Endpoint and Semantic Transition Learning for Zero-Shot Composed Image Retrievalcited by 0
- 2026Benchmarking Composed Image Retrieval for Applied Earth Observationcited by 0
- 2026Benchmarking Composed Image Retrieval for Applied Earth Observation23 May 2026
- 2026Decoupling Endpoint and Semantic Transition Learning for Zero-Shot Composed Image Retrieval8 May 2026
- 2025An Efficient and Effective Encoder Model for Vision and Language Tasks in the Remote Sensing Domain17 Dec 2025
- 2025VLM2GeoVec: Toward Universal Multimodal Embeddings for Remote Sensing12 Dec 2025
- 2025FIGROTD: A Friendly-to-Handle Dataset for Image Guided Retrieval with Optional Text27 Nov 2025
- 2025Instance-Level Composed Image Retrieval29 Oct 2025
- 2025OASIS: Online Sample Selection for Continual Visual Instruction Tuning27 May 2025
- 2025ConText-CIR: Learning from Concepts in Text for Composed Image Retrieval27 May 2025
- 2025CoLLM: A Large Language Model for Composed Image Retrieval25 Mar 2025
- 2025Composed Multi-modal Retrieval: A Survey of Approaches and Applications3 Mar 2025
- 2025A Comprehensive Survey on Composed Image Retrieval19 Feb 2025
- 2024Composed Image Retrieval for Training-Free Domain Conversion4 Dec 2024
Similar, not cited
Close in wording, no citation either way
- 2025Beyond Pixels: A Training-Free, Text-to-Text Framework for Remote Sensing Image Retrieval
- 2024Knowledge-aware Text-Image Retrieval for Remote Sensing Images
- 2024ImageRAG: Enhancing Ultra High Resolution Remote Sensing Imagery Analysis with ImageRAG
- 2026Fast-then-Fine: A Two-Stage Framework with Multi-Granular Representation for Cross-Modal Retrieval in Remote Sensing
- 2025Remote Sensing Retrieval-Augmented Generation: Bridging Remote Sensing Imagery and Comprehensive Knowledge with a Multi-Modal Dataset and Retrieval-Augmented Generation Model
- 2026PinPoint: Evaluation of Composed Image Retrieval with Explicit Negatives, Multi-Image Queries, and Paraphrase Testing
- 2024From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing
- 2026A Sanity Check on Composed Image Retrieval