DVGBench: Implicit-to-Explicit Visual Grounding Benchmark in UAV Imagery with Large Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Remote sensing (RS) large vision-language models (LVLMs) have shown strong promise across visual grounding (VG) tasks. However, existing RS VG datasets predominantly rely on explicit referring expressions-such as relative position, relative size, and color cues-thereby constraining performance on implicit VG tasks that require scenario-specific domain knowledge. This article introduces DVGBench, a high-quality implicit VG benchmark for drones, covering six major application scenarios: traffic, disaster, security, sport, social activity, and productive activity. Each object provides both explicit and implicit queries. Based on the dataset, we design DroneVG-R1, an LVLM that integrates the novel Implicit-to-Explicit Chain-of-Thought (I2E-CoT) within a reinforcement learning paradigm. This enables the model to take advantage of scene-specific expertise, converting implicit references into explicit ones and thus reducing grounding difficulty. Finally, an evaluation of mainstream models on both explicit and implicit VG tasks reveals substantial limitations in their reasoning capabilities. These findings provide actionable insights for advancing the reasoning capacity of LVLMs for drone-based agents. The code and datasets will be released at https://github.com/zytx121/DVGBench
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 27 of its 43 references that are in the map. First posted on arXiv 2 Jan 2026.
Builds on
27 of 43 references.
Closest ancestors · 5
Same direction, newest first
- 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensing23 Jan
- 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Grounding16 Nov
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
Other references · 22
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2016Modeling Context in Referring Expressionscited by 1,063
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2020Detection and Tracking Meet Drones Challengecited by 263
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
- 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 222
- 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 123
- 2020PhraseCut: Language-based Image Segmentation in the Wildcited by 116
- 2023NExT-Chat: An LMM for Chat, Detection and Segmentationcited by 80
- 2020Referring Expression Comprehension: A Survey of Methods and Datasetscited by 79
10 more
- 2023Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentationcited by 76
- 2023RRSIS: Referring Remote Sensing Image Segmentationcited by 59
- 2025Look-Back: Implicit Visual Re-focusing in MLLM Reasoningcited by 55
- 2022TransVG++: End-to-End Visual Grounding with Language Conditioned Vision Transformercited by 42
- 2025SegEarth-R1: Geospatial Pixel Reasoning via Large Language Modelcited by 42
- 2025RemoteSAM: Towards Segment Anything for Earth Observationcited by 39
- 2022Detecting Rotated Objects as Gaussian Distributions and Its 3-D Generalizationcited by 36
- 2022Dynamic MDETR: A Dynamic Multimodal Transformer Decoder for Visual Groundingcited by 29
- 2020ERA: A Dataset and Deep Learning Benchmark for Event Recognition in Aerial Videoscited by 18
- 2023Iterative Robust Visual Grounding with Masked Reference based Centerpoint Supervisioncited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Taskscited by 4
- 2026α3-SecBench: A Large-Scale Evaluation Suite of Security, Resilience, and Trust for LLM-based UAV Agents over 6G Networkscited by 2
- 2026AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoningcited by 1
- 2026GrabVG: Graph-Attentive Binding for Visual Grounding in UAV Imagerycited by 0
- 2026GrabVG: Graph-Attentive Binding for Visual Grounding in UAV Imagery19 Aug 2026
- 2026AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoning12 Aug 2026
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks9 Jun 2026
- 2026α3-SecBench: A Large-Scale Evaluation Suite of Security, Resilience, and Trust for LLM-based UAV Agents over 6G Networks26 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoning
- 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos
- 2026Can Vision-Language Models Think from the Sky? Unifying UAV Reasoning and Generation
- 2025UAV-VL-R1: Generalizing Vision-Language Models via Supervised Fine-Tuning and Multi-Stage GRPO for UAV Visual Reasoning
- 2025AerialVG: A Challenging Benchmark for Aerial Visual Grounding by Exploring Positional Relations
- 2026UAVBench and UAVIT-1M: Benchmarking and Enhancing MLLMs for Low-Altitude UAV Vision-Language Understanding
- 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs
- 2026WildRoadBench: A Wild Aerial Road-Damage Grounding Benchmark for Vision-Language Models and Autonomous Agents