MARIS: Marine Open-Vocabulary Instance Segmentation with Geometric Enhancement and Semantic Alignment
Not on the map. Why?
Abstract (arXiv)
Most existing underwater instance segmentation approaches are constrained by close-vocabulary prediction, limiting their ability to recognize novel marine categories. To support evaluation, we introduce MARIS (underlineMarine Open-Vocabulary underlineInstance underlineSegmentation), the first large-scale fine-grained benchmark for underwater Open-Vocabulary (OV) segmentation, featuring a limited set of seen categories and diverse unseen categories. Although OV segmentation has shown promise on natural images, our analysis reveals that transfer to underwater scenes suffers from severe visual degradation (e.g., color attenuation) and semantic misalignment caused by lack underwater class definitions. To address these issues, we propose a unified framework with two complementary components. The Geometric Prior Enhancement Module (GPEM) leverages stable part-level and structural cues to maintain object consistency under degraded visual conditions. The Semantic Alignment Injection Mechanism (SAIM) enriches language embeddings with domain-specific priors, mitigating semantic ambiguity and improving recognition of unseen categories. Experiments show that our framework consistently outperforms existing OV baselines both In-Domain and Cross-Domain setting on MARIS, establishing a strong foundation for future underwater perception research.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 37 of its 59 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
37 of 59 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
- 2022Language-driven Semantic Segmentationcited by 717
- 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 565
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 375
- 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 300
25 more
- 2021A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Modelcited by 223
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 219
- 2023Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIPcited by 201
- 2022MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image Pretrainingcited by 187
- 2023SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentationcited by 97
- 2020Semantic Segmentation of Underwater Imagery: Dataset and Benchmarkcited by 95
- 2023FreeSeg: Unified, Universal and Open-Vocabulary Image Segmentationcited by 95
- 2023Open-Vocabulary Segmentation with Semantic-Assisted Calibrationcited by 49
- 2024Collaborative Vision-Text Representation Optimizing for Open-Vocabulary Segmentationcited by 41
- 2024Open-Vocabulary Semantic Segmentation with Image Embedding Balancingcited by 35
- 2024Diving into Underwater: Segment Anything Model Guided Underwater Salient Instance Segmentation and A Large-scale Datasetcited by 33
- 2025Fine-Grained Preference Optimization Improves Spatial Reasoning in VLMscited by 32
- 2024Unsupervised Hyperspectral Image Super-Resolution via Self-Supervised Modality Decouplingcited by 26
- 2025Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigationcited by 17
- 2024U3M: Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentationcited by 13
- 2025USIS16K: High-Quality Dataset for Underwater Salient Instance Segmentationcited by 10
- 2024Generalization Boosted Adapter for Open-Vocabulary Segmentationcited by 9
- 2023CaveSeg: Deep Semantic Segmentation and Scene Parsing for Autonomous Underwater Cave Explorationcited by 7
- 2025FGAseg: Fine-Grained Pixel-Text Alignment for Open-Vocabulary Semantic Segmentationcited by 5
- 2025Training Data Provenance Verification: Did Your Model Use Synthetic Data from My Generative Model for Training?cited by 4
- 2025Improving underwater semantic segmentation with underwater image quality attention and muti-scale aggregation attentioncited by 4
- 2025UVLM: Benchmarking Video Language Model for Underwater World Understandingcited by 3
- 2025Efficient Redundancy Reduction for Open-Vocabulary Semantic Segmentationcited by 2
- 2021An Underwater Image Semantic Segmentation Method Focusing on Boundaries and a Real Underwater Scene Semantic Segmentation Datasetcited by 1
- 2025AUTV: Creating Underwater Video Datasets with Pixel-wise Annotationscited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 14.
15 papers.
Sort:
By area:
- 2026PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulationcited by 21
- 2025Exploring the Underwater World Segmentation without Extra Trainingcited by 16
- 2026The Second Challenge on Cross-Domain Few-Shot Object Detection at NTIRE 2026: Methods and Resultscited by 13
- 2026When Models Learn to Ask Why: Adaptive Causal Reasoning for Trustworthy Medical Vision-Language Modelscited by 6
- 2026Pansharpening for Thin-Cloud Contaminated Remote Sensing Images: A Unified Framework and Benchmark Datasetcited by 5
- 2026CNMBI: Determining the Number of Clusters Using Center Pairwise Matching and Boundary Filteringcited by 1
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentationcited by 1
- 2026UW-VOS: A Large-Scale Dataset for Underwater Video Object Segmentationcited by 0
- 2026The Devil Is in Gradient Entanglement: Energy-Aware Gradient Coordinator for Robust Generalized Category Discoverycited by 0
- 2026Detect in Any Scene: An Agentic Framework for Object Detection with Experience-Aware Reasoningcited by 0
- 2026Conformal Risk Prediction for Non-Alcoholic Fatty Liver Disease Using Gradient Boosting with Distribution-Free Coveragescited by 0
- 2026VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inferencecited by 0
3 more
- 2026Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivotingcited by 0
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verificationcited by 0
- 2026Cross-Modal Hierarchical Fusion for from Multi-Sensor Ground Observationcited by 0
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivoting13 Jun 2026
- 2026Cross-Modal Hierarchical Fusion for from Multi-Sensor Ground Observation31 May 2026
- 2026VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inference31 May 2026
- 2026Conformal Risk Prediction for Non-Alcoholic Fatty Liver Disease Using Gradient Boosting with Distribution-Free Coverages31 May 2026
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation31 May 2026
- 2026Detect in Any Scene: An Agentic Framework for Object Detection with Experience-Aware Reasoning29 May 2026
- 2026The Second Challenge on Cross-Domain Few-Shot Object Detection at NTIRE 2026: Methods and Results13 Apr 2026
- 2026The Devil Is in Gradient Entanglement: Energy-Aware Gradient Coordinator for Robust Generalized Category Discovery25 Mar 2026
- 2026UW-VOS: A Large-Scale Dataset for Underwater Video Object Segmentation25 Mar 2026
- 2026When Models Learn to Ask Why: Adaptive Causal Reasoning for Trustworthy Medical Vision-Language Models24 Mar 2026
- 2026CNMBI: Determining the Number of Clusters Using Center Pairwise Matching and Boundary Filtering23 Mar 2026
3 more
- 2026Pansharpening for Thin-Cloud Contaminated Remote Sensing Images: A Unified Framework and Benchmark Dataset16 Mar 2026
- 2026PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulation11 Jan 2026
- 2025Exploring the Underwater World Segmentation without Extra Training11 Nov 2025
- 2026When Models Learn to Ask Why: Adaptive Causal Reasoning for Trustworthy Medical Vision-Language Modelscited by 6
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentationcited by 1
- 2026Detect in Any Scene: An Agentic Framework for Object Detection with Experience-Aware Reasoningcited by 0
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation31 May 2026
- 2026Detect in Any Scene: An Agentic Framework for Object Detection with Experience-Aware Reasoning29 May 2026
- 2026When Models Learn to Ask Why: Adaptive Causal Reasoning for Trustworthy Medical Vision-Language Models24 Mar 2026
- 2025Exploring the Underwater World Segmentation without Extra Trainingcited by 16
- 2026The Second Challenge on Cross-Domain Few-Shot Object Detection at NTIRE 2026: Methods and Resultscited by 13
- 2026Pansharpening for Thin-Cloud Contaminated Remote Sensing Images: A Unified Framework and Benchmark Datasetcited by 5
- 2026CNMBI: Determining the Number of Clusters Using Center Pairwise Matching and Boundary Filteringcited by 1
- 2026UW-VOS: A Large-Scale Dataset for Underwater Video Object Segmentationcited by 0
- 2026The Devil Is in Gradient Entanglement: Energy-Aware Gradient Coordinator for Robust Generalized Category Discoverycited by 0
- 2026Conformal Risk Prediction for Non-Alcoholic Fatty Liver Disease Using Gradient Boosting with Distribution-Free Coveragescited by 0
- 2026VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inferencecited by 0
- 2026Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivotingcited by 0
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verificationcited by 0
- 2026Cross-Modal Hierarchical Fusion for from Multi-Sensor Ground Observationcited by 0
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026Bridging Geographic Bias in Urban Streetscape Inference via Lifelong Learning with Visual-Semantic Pivoting13 Jun 2026
- 2026Cross-Modal Hierarchical Fusion for from Multi-Sensor Ground Observation31 May 2026
- 2026VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inference31 May 2026
- 2026Conformal Risk Prediction for Non-Alcoholic Fatty Liver Disease Using Gradient Boosting with Distribution-Free Coverages31 May 2026
- 2026The Second Challenge on Cross-Domain Few-Shot Object Detection at NTIRE 2026: Methods and Results13 Apr 2026
- 2026The Devil Is in Gradient Entanglement: Energy-Aware Gradient Coordinator for Robust Generalized Category Discovery25 Mar 2026
- 2026UW-VOS: A Large-Scale Dataset for Underwater Video Object Segmentation25 Mar 2026
- 2026CNMBI: Determining the Number of Clusters Using Center Pairwise Matching and Boundary Filtering23 Mar 2026
- 2026Pansharpening for Thin-Cloud Contaminated Remote Sensing Images: A Unified Framework and Benchmark Dataset16 Mar 2026
- 2025Exploring the Underwater World Segmentation without Extra Training11 Nov 2025