A Structured Review of Underwater Object Detection Challenges and Solutions: From Traditional to Large Vision Language Models
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Underwater object detection (UOD) is vital to diverse marine applications, including oceanographic research, underwater robotics, and marine conservation. However, UOD faces numerous challenges that compromise its performance. Over the years, various methods have been proposed to address these issues, but they often fail to fully capture the complexities of underwater environments. This review systematically categorizes UOD challenges into five key areas: Image quality degradation, target-related issues, data-related challenges, computational and processing constraints, and limitations in detection methodologies. To address these challenges, we analyze the progression from traditional image processing and object detection techniques to modern approaches. Additionally, we explore the potential of large vision-language models (LVLMs) in UOD, leveraging their multi-modal capabilities demonstrated in other domains. We also present case studies, including synthetic dataset generation using DALL-E 3 and fine-tuning Florence-2 LVLM for UOD. This review identifies three key insights: (i) Current UOD methods are insufficient to fully address challenges like image degradation and small object detection in dynamic underwater environments. (ii) Synthetic data generation using LVLMs shows potential for augmenting datasets but requires further refinement to ensure realism and applicability. (iii) LVLMs hold significant promise for UOD, but their real-time application remains under-explored, requiring further research on optimization techniques.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 43 of its 147 references that are in the map. First posted on arXiv 10 Sep 2025.
Builds on
43 of 147 references.
Closest ancestors · 1
Same direction, newest first
Other references · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Generative Adversarial Networkscited by 5,627
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
30 more
- 2023PaLM 2 Technical Reportcited by 1,162
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 681
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
- 2024MoE-LLaVA: Mixture of Experts for Large Vision-Language Modelscited by 300
- 2024InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDcited by 159
- 2024The Revolution of Multimodal Large Language Models: A Surveycited by 137
- 2024Baichuan-Omni Technical Reportcited by 42
- 2024Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Modelscited by 35
- 2024ViGoR: Improving Visual Grounding of Large Vision Language Models with Fine-Grained Reward Modelingcited by 34
- 2022Roboflow 100: A Rich, Multi-Domain Object Detection Benchmarkcited by 26
- 2024CoLLaVO: Crayon Large Language and Vision mOdelcited by 26
- 2024LAPT: Label-driven Automated Prompt Tuning for OOD Detection with Vision-Language Modelscited by 21
- 2022Boosting R-CNN: Reweighting R-CNN Samples by RPN's Error for Underwater Object Detectioncited by 10
- 2024RelationVLM: Making Large Vision-Language Models Understand Visual Relationscited by 9
- 2024LLMRA: Multi-modal Large Language Model based Restoration Assistantcited by 8
- 2024Underwater Object Detection in the Era of Artificial Intelligence: Current, Challenge, and Futurecited by 8
- 2024PHISWID: Physics-Inspired Underwater Image Dataset Synthesized from RGB-D Imagescited by 6
- 2023Generative AI in Agriculture: Creating Image Datasets Using DALL.E's Advanced Large Language Model Capabilitiescited by 5
- 2024Syn2Real Domain Generalization for Underwater Mine-like Object Detection Using Side-Scan Sonarcited by 4
- 2024Segment Anything Model for automated image data annotation: empirical studies using text prompts from Grounding DINOcited by 3
- 2024DALL-M: Context-Aware Clinical Data Augmentation with LLMscited by 2
- 2024IDA-UIE: An Iterative Framework for Deep Network-based Degradation Aware Underwater Image Enhancementcited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MATANet: A Multi-context Attention and Taxonomy-Aware Network for Fine-Grained Underwater Recognition of Marine Speciescited by 1
- 2026Why Domain Matters: A Preliminary Study of Domain Effects in Underwater Object Detectioncited by 0
- 2026A Marine Debris Detection Framework for Ocean Robots via Self-Attention Enhancement and Feature Interaction Optimizationcited by 0
- 2026Why Domain Matters: Domain-Aware Benchmarking of Underwater Object Detection and Annotation Qualitycited by 0
- 2026Why Domain Matters: Domain-Aware Benchmarking of Underwater Object Detection and Annotation Quality12 Jul 2026
- 2026A Marine Debris Detection Framework for Ocean Robots via Self-Attention Enhancement and Feature Interaction Optimization8 May 2026
- 2026Why Domain Matters: A Preliminary Study of Domain Effects in Underwater Object Detection28 Apr 2026
- 2026MATANet: A Multi-context Attention and Taxonomy-Aware Network for Fine-Grained Underwater Recognition of Marine Species7 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025UWBench: A Comprehensive Vision-Language Benchmark for Underwater Understanding
- 2025Advancing Marine Research: UWSAM Framework and UIIS10K Dataset for Precise Underwater Instance Segmentation
- 2026RSOD: Reliability-Guided Sonar Image Object Detection with Extremely Limited Labels
- 2025WaterFlow: Explicit Physics-Prior Rectified Flow for Underwater Saliency Mask Generation
- 2026SPMamba-YOLO: An Underwater Object Detection Network Based on Multi-Scale Feature Enhancement and Global Context Modeling
- 2026Assessing Vision-Language Models for Perception in Autonomous Underwater Robotic Software
- 2025AquaticCLIP: A Vision-Language Foundation Model for Underwater Scene Analysis
- 2025UIS-Mamba: Exploring Mamba for Underwater Instance Segmentation via Dynamic Tree Scan and Hidden State Weaken