FUSE-RSVLM: Feature Fusion Vision-Language Model for Remote Sensing
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Large vision-language models (VLMs) exhibit strong performance across various tasks. However, these VLMs encounter significant challenges when applied to the remote sensing domain due to the inherent differences between remote sensing images and natural images. Existing remote sensing VLMs often fail to extract fine-grained visual features and suffer from visual forgetting during deep language processing. To address this, we introduce MF-RSVLM, a Multi-Feature Fusion Remote Sensing Vision--Language Model that effectively extracts and fuses visual features for RS understanding. MF-RSVLM learns multi-scale visual representations and combines global context with local details, improving the capture of small and complex structures in RS scenes. A recurrent visual feature injection scheme ensures the language model remains grounded in visual evidence and reduces visual forgetting during generation. Extensive experiments on diverse RS benchmarks show that MF-RSVLM achieves state-of-the-art or highly competitive performance across remote sensing classification, image captioning, and VQA tasks. Our code is publicly available at https://github.com/Yunkaidang/RSVLM.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 49 of its 71 references that are in the map. First posted on arXiv 30 Dec 2025.
Builds on
49 of 71 references.
Closest ancestors · 15
Same direction, newest first
- 2025GeoMag: A Vision-Language Model for Pixel-level Fine-Grained Remote Sensing Image Parsing8 Jul
- 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolution27 May
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May
- 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruning10 Mar
- 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensing23 Jan
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
- 2024RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Experts7 Dec
- 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Grounding16 Nov
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
3 more
Other references · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
22 more
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 617
- 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 545
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 339
- 2017Functional Map of the Worldcited by 338
- 2023InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Compositioncited by 297
- 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 197
- 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 195
- 2023Multimodal Large Language Models: A Surveycited by 193
- 2021FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagerycited by 143
- 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
- 2025FlexiMo: A Flexible Remote Sensing Foundation Modelcited by 24
- 2024SM3Det: A Unified Model for Multi-Modal Remote Sensing Object Detectioncited by 22
- 2022METER-ML: A Multi-Sensor Earth Observation Benchmark for Automated Methane Source Mappingcited by 17
- 2025HyperFree: A Channel-adaptive and Tuning-free Foundation Model for Hyperspectral Remote Sensing Imagerycited by 16
- 2023RSAdapter: Adapting Multimodal Models for Remote Sensing Visual Question Answeringcited by 11
- 2023Exploring vision transformer layer choosing for semantic segmentationcited by 1
- 2025P2HCT: Plug-and-Play Hierarchical C2F Transformer for Multi-Scale Feature Fusioncited by 1
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMscited by 7
- 2026UHR-BAT: Budget-Aware Token Compression Vision-Language model for Ultra-High-Resolution Remote Sensingcited by 1
- 2026CLASP: Class-Adaptive Layer Fusion and Dual-Stage Pruning for Multimodal Large Language Modelscited by 0
- 2026UHR-BAT: Budget-Aware Token Compression Vision-Language model for Ultra-High-Resolution Remote Sensing15 Apr 2026
- 2026CLASP: Class-Adaptive Layer Fusion and Dual-Stage Pruning for Multimodal Large Language Models14 Apr 2026
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMs9 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
- 2024Advancements in Visual Language Models for Remote Sensing: Datasets, Capabilities, and Enhancement Techniques
- 2025Co-Training Vision Language Models for Remote Sensing Multi-task Learning
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing
- 2025A Vision Centric Remote Sensing Benchmark
- 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing
- 2023Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignment
- 2025Enhancing Remote Sensing Vision-Language Models Through MLLM and LLM-Based High-Quality Image-Text Dataset Generation