mlsanityData to 14 Oct 2026

A Structured Review of Underwater Object Detection Challenges and Solutions: From Traditional to Large Vision Language Models

arXiv 2509.08490 ↗First posted 10 Sep 2025cs.CV cs.AIcited by 4

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Underwater object detection (UOD) is vital to diverse marine applications, including oceanographic research, underwater robotics, and marine conservation. However, UOD faces numerous challenges that compromise its performance. Over the years, various methods have been proposed to address these issues, but they often fail to fully capture the complexities of underwater environments. This review systematically categorizes UOD challenges into five key areas: Image quality degradation, target-related issues, data-related challenges, computational and processing constraints, and limitations in detection methodologies. To address these challenges, we analyze the progression from traditional image processing and object detection techniques to modern approaches. Additionally, we explore the potential of large vision-language models (LVLMs) in UOD, leveraging their multi-modal capabilities demonstrated in other domains. We also present case studies, including synthetic dataset generation using DALL-E 3 and fine-tuning Florence-2 LVLM for UOD. This review identifies three key insights: (i) Current UOD methods are insufficient to fully address challenges like image degradation and small object detection in dynamic underwater environments. (ii) Synthetic data generation using LVLMs shows potential for augmenting datasets but requires further refinement to ensure realism and applicability. (iii) LVLMs hold significant promise for UOD, but their real-time application remains under-explored, requiring further research on optimization techniques.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 43 of its 147 references that are in the map. First posted on arXiv 10 Sep 2025.

Builds on

43 of 147 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023PaLM-E: An Embodied Multimodal Language Model6 Mar

Other references · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  7. 2022Generative Adversarial Networkscited by 5,627
  8. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  9. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  10. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  11. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
  12. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
30 more
  1. 2023PaLM 2 Technical Reportcited by 1,162
  2. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  3. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
  4. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 681
  5. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
  6. 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
  7. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
  8. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  9. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
  10. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332
  11. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
  12. 2024MoE-LLaVA: Mixture of Experts for Large Vision-Language Modelscited by 300
  13. 2024InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDcited by 159
  14. 2024The Revolution of Multimodal Large Language Models: A Surveycited by 137
  15. 2024Baichuan-Omni Technical Reportcited by 42
  16. 2024Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Modelscited by 35
  17. 2024ViGoR: Improving Visual Grounding of Large Vision Language Models with Fine-Grained Reward Modelingcited by 34
  18. 2022Roboflow 100: A Rich, Multi-Domain Object Detection Benchmarkcited by 26
  19. 2024CoLLaVO: Crayon Large Language and Vision mOdelcited by 26
  20. 2024LAPT: Label-driven Automated Prompt Tuning for OOD Detection with Vision-Language Modelscited by 21
  21. 2022Boosting R-CNN: Reweighting R-CNN Samples by RPN's Error for Underwater Object Detectioncited by 10
  22. 2024RelationVLM: Making Large Vision-Language Models Understand Visual Relationscited by 9
  23. 2024LLMRA: Multi-modal Large Language Model based Restoration Assistantcited by 8
  24. 2024Underwater Object Detection in the Era of Artificial Intelligence: Current, Challenge, and Futurecited by 8
  25. 2024PHISWID: Physics-Inspired Underwater Image Dataset Synthesized from RGB-D Imagescited by 6
  26. 2023Generative AI in Agriculture: Creating Image Datasets Using DALL.E's Advanced Large Language Model Capabilitiescited by 5
  27. 2024Syn2Real Domain Generalization for Underwater Mine-like Object Detection Using Side-Scan Sonarcited by 4
  28. 2024Segment Anything Model for automated image data annotation: empirical studies using text prompts from Grounding DINOcited by 3
  29. 2024DALL-M: Context-Aware Clinical Data Augmentation with LLMscited by 2
  30. 2024IDA-UIE: An Iterative Framework for Deep Network-based Degradation Aware Underwater Image Enhancementcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025UWBench: A Comprehensive Vision-Language Benchmark for Underwater Understanding
  2. 2025Advancing Marine Research: UWSAM Framework and UIIS10K Dataset for Precise Underwater Instance Segmentation
  3. 2026RSOD: Reliability-Guided Sonar Image Object Detection with Extremely Limited Labels
  4. 2025WaterFlow: Explicit Physics-Prior Rectified Flow for Underwater Saliency Mask Generation
  5. 2026SPMamba-YOLO: An Underwater Object Detection Network Based on Multi-Scale Feature Enhancement and Global Context Modeling
  6. 2026Assessing Vision-Language Models for Perception in Autonomous Underwater Robotic Software
  7. 2025AquaticCLIP: A Vision-Language Foundation Model for Underwater Scene Analysis
  8. 2025UIS-Mamba: Exploring Mamba for Underwater Instance Segmentation via Dynamic Tree Scan and Hidden State Weaken