ShellfishNet: A Domain-Specific Benchmark for Visual Recognition of Marine Molluscs
Not on the map. Why?
Abstract (arXiv)
Reliable visual recognition of shellfish is important for ecological monitoring and aquaculture, but real-world imagery exhibits substantial variation in acquisition conditions, appearance, and posture. Existing marine vision resources cover diverse taxa and imaging settings, but fine-grained mollusc recognition remains underexplored in a group-disjoint benchmark that jointly evaluates class prediction, representation-space retrieval, and condition sensitivity. To address this gap, we introduce ShellfishNet, a provenance-aware, group-disjoint benchmark of 40,130 images from 100 marine mollusc classes, organized into 30,879 acquisition or observation groups. Rather than treating recognition as a single clean-accuracy leaderboard, ShellfishNet evaluates model configurations across classification, image-to-image retrieval, taxonomic error structure, and controlled condition sensitivity. We benchmark representative convolutional, transformer-based, hybrid and efficient, self-supervised, and vision-language models on classification and retrieval. Separately, we evaluate open image-captioning and vision-language models on the captioning subset and assess selected fixed checkpoints under controlled generic and marine-inspired synthetic transformations. Across the benchmark, image-level and class-aware classification largely agree, whereas retrieval provides complementary model rankings and taxonomy projection reveals that a non-negligible subset of exact-class errors remains correct at higher taxonomic ranks. Selected fixed checkpoints with similar clean accuracy can also exhibit distinct sensitivity profiles under controlled transformations. These results show that model comparison on shellfish imagery should account for both task and image condition, rather than rely on a single clean classification score. The dataset and evaluation protocols will be publicly released.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 133 of its 173 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
133 of 173 references.
References · 133
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
38 more
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2022A ConvNet for the 2020scited by 3,545
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2024Qwen2 Technical Reportcited by 2,076
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2019Searching for MobileNetV3cited by 1,984
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
- 2024VMamba: Visual State Space Modelcited by 955
- 2020Designing Network Design Spacescited by 954
- 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 937
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
- 2017Selective Classification for Deep Neural Networkscited by 799
50 most cited of 133 All 133 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Benchmarking Large Language Models for Image Classification of Marine Mammals
- 2024Composing Open-domain Vision with RAG for Ocean Monitoring and Conservation
- 2025ReefNet: A Large-Scale Dataset and Benchmark for Fine-Grained Coral Reef Recognition
- 2025UWBench: A Comprehensive Vision-Language Benchmark for Underwater Understanding
- 2025FishAI 2.0: Marine Fish Image Classification with Multi-modal Few-shot Learning
- 2024ODYSSEE: Oyster Detection Yielded by Sensor Systems on Edge Electronics
- 2026Teach a Molmo2Fish: Towards interactive fish tracking with natural language guidance
- 2025AquaticCLIP: A Vision-Language Foundation Model for Underwater Scene Analysis