UWBench: A Comprehensive Vision-Language Benchmark for Underwater Understanding
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Large vision-language models (VLMs) have achieved remarkable success in natural scene understanding, yet their application to underwater environments remains largely unexplored. Underwater imagery presents unique challenges including severe light attenuation, color distortion, and suspended particle scattering, while requiring specialized knowledge of marine ecosystems and organism taxonomy. To bridge this gap, we introduce UWBench, a comprehensive benchmark specifically designed for underwater vision-language understanding. UWBench comprises 15,003 high-resolution underwater images captured across diverse aquatic environments, encompassing oceans, coral reefs, and deep-sea habitats. Each image is enriched with human-verified annotations including 15,281 object referring expressions that precisely describe marine organisms and underwater structures, and 124,983 question-answer pairs covering diverse reasoning capabilities from object recognition to ecological relationship understanding. The dataset captures rich variations in visibility, lighting conditions, and water turbidity, providing a realistic testbed for model evaluation. Based on UWBench, we establish three comprehensive benchmarks: detailed image captioning for generating ecologically informed scene descriptions, visual grounding for precise localization of marine organisms, and visual question answering for multimodal reasoning about underwater environments. Extensive experiments on state-of-the-art VLMs demonstrate that underwater understanding remains challenging, with substantial room for improvement. Our benchmark provides essential resources for advancing vision-language research in underwater contexts and supporting applications in marine science, ecological monitoring, and autonomous underwater exploration. Our code and benchmark will be available.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 63 of its 94 references that are in the map. First posted on arXiv 21 Oct 2025.
Builds on
63 of 94 references.
Closest ancestors · 1
Same direction, newest first
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
Other references · 62
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2025Qwen3 Technical Reportcited by 8,195
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2025DINOv3cited by 1,297
38 more
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
- 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 368
- 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
- 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 250
- 2023LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Modelscited by 217
- 2019Fast Underwater Image Enhancement for Improved Visual Perceptioncited by 181
- 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 132
- 2024IBD: Alleviating Hallucinations in Large Vision-Language Models via Image-Biased Decodingcited by 118
- 2017WaterGAN: Unsupervised Generative Network to Enable Real-time Color Correction of Monocular Underwater Imagescited by 112
- 2021U-shape Transformer for Underwater Image Enhancementcited by 110
- 2025Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Modelscited by 104
- 2020Semantic Segmentation of Underwater Imagery: Dataset and Benchmarkcited by 95
- 2019Real-world Underwater Enhancement: Challenges, Benchmarks, and Solutionscited by 89
- 2024OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generationcited by 77
- 2024DreamLIP: Language-Image Pre-training with Long Captionscited by 72
- 2024Revisiting Referring Expression Comprehension Evaluation in the Era of Large Multimodal Modelscited by 52
- 2024Toward Visual Grounding: A Surveycited by 52
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentationcited by 41
- 2023Improving Automatic VQA Evaluation Using Large Language Modelscited by 37
- 2021Domain Adaptation for Underwater Image Enhancementcited by 35
- 2024Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robotscited by 32
- 2021A Dataset And Benchmark Of Underwater Object Detection For Robot Pickingcited by 31
- 2025Policy-as-Prompt: Rethinking Content Moderation in the Age of Large Language Modelscited by 29
- 2024FINECAPTION: Compositional Image Captioning Focusing on Wherever You Want at Any Granularitycited by 26
- 2024A Survey on Text-guided 3D Visual Grounding: Elements, Recent Advances, and Future Directionscited by 24
- 2023MarineGPT: Unlocking Secrets of Ocean to the Publiccited by 23
- 2023Context Disentangling and Prototype Inheriting for Robust Visual Groundingcited by 23
- 2025Image Captioning Evaluation in the Age of Multimodal LLMs: Challenges and Future Perspectivescited by 17
- 2022A Comprehensive Review on Autonomous Navigationcited by 16
- 2024VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robotscited by 16
- 2023Semi-Supervised Visual Tracking of Marine Animals using Autonomous Underwater Vehiclescited by 15
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentationcited by 1
- 2026Can Multimodal Large Language Models Truly Understand Small Objects?cited by 0
- 2026Learning Structured Visual Compositional Representations for Weakly Supervised Referring Expression Comprehensioncited by 0
- 2026MarineEVT: Advancing Event-Centric Marine Video Understanding via Visual Tool Reasoningcited by 0
- 2026MarineEVT: Advancing Event-Centric Marine Video Understanding via Visual Tool Reasoning27 Jul 2026
- 2026Learning Structured Visual Compositional Representations for Weakly Supervised Referring Expression Comprehension6 Jul 2026
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation31 May 2026
- 2026Can Multimodal Large Language Models Truly Understand Small Objects?24 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025AquaticCLIP: A Vision-Language Foundation Model for Underwater Scene Analysis
- 2025Exploring the Underwater World Segmentation without Extra Training
- 2025MarineEval: Assessing the Marine Intelligence of Vision-Language Models
- 2026MARINER: A 3E-Driven Benchmark for Fine-Grained Perception and Complex Reasoning in Open-Water Environments
- 2025A Structured Review of Underwater Object Detection Challenges and Solutions: From Traditional to Large Vision Language Models
- 2026Evaluation of Vision-Language Models Across Diverse Coastal Environments
- 2025NAUTILUS: A Large Multimodal Model for Underwater Scene Understanding
- 2026SonarLLM: A Native Sonar--Optical Multimodal Large Language Model for Underwater Perception