mlsanityData to 7 Oct 2026

ShellfishNet: A Domain-Specific Benchmark for Visual Recognition of Marine Molluscs

arXiv 2605.07338 ↗First posted 8 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reliable visual recognition of shellfish is important for ecological monitoring and aquaculture, but real-world imagery exhibits substantial variation in acquisition conditions, appearance, and posture. Existing marine vision resources cover diverse taxa and imaging settings, but fine-grained mollusc recognition remains underexplored in a group-disjoint benchmark that jointly evaluates class prediction, representation-space retrieval, and condition sensitivity. To address this gap, we introduce ShellfishNet, a provenance-aware, group-disjoint benchmark of 40,130 images from 100 marine mollusc classes, organized into 30,879 acquisition or observation groups. Rather than treating recognition as a single clean-accuracy leaderboard, ShellfishNet evaluates model configurations across classification, image-to-image retrieval, taxonomic error structure, and controlled condition sensitivity. We benchmark representative convolutional, transformer-based, hybrid and efficient, self-supervised, and vision-language models on classification and retrieval. Separately, we evaluate open image-captioning and vision-language models on the captioning subset and assess selected fixed checkpoints under controlled generic and marine-inspired synthetic transformations. Across the benchmark, image-level and class-aware classification largely agree, whereas retrieval provides complementary model rankings and taxonomy projection reveals that a non-negligible subset of exact-class errors remains correct at higher taxonomic ranks. Selected fixed checkpoints with similar clean accuracy can also exhibit distinct sensitivity profiles under controlled transformations. These results show that model comparison on shellfish imagery should account for both task and image condition, rather than rely on a single clean classification score. The dataset and evaluation protocols will be publicly released.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 133 of its 173 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

133 of 173 references.

References · 133

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  8. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  9. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  10. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  11. 2016Densely Connected Convolutional Networkscited by 6,691
  12. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
38 more
  1. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  2. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2017On Calibration of Modern Neural Networkscited by 4,860
  5. 2024Qwen2.5 Technical Reportcited by 4,713
  6. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  8. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  9. 2022A ConvNet for the 2020scited by 3,545
  10. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  11. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  12. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  13. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  14. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  15. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  16. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  17. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  18. 2024Qwen2 Technical Reportcited by 2,076
  19. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  20. 2019Searching for MobileNetV3cited by 1,984
  21. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
  22. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  23. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  24. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
  25. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
  26. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  27. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
  28. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
  29. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
  30. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  31. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  32. 2024VMamba: Visual State Space Modelcited by 955
  33. 2020Designing Network Design Spacescited by 954
  34. 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 937
  35. 2023A Survey on Multimodal Large Language Modelscited by 898
  36. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
  37. 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
  38. 2017Selective Classification for Deep Neural Networkscited by 799

50 most cited of 133 All 133 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Benchmarking Large Language Models for Image Classification of Marine Mammals
  2. 2024Composing Open-domain Vision with RAG for Ocean Monitoring and Conservation
  3. 2025ReefNet: A Large-Scale Dataset and Benchmark for Fine-Grained Coral Reef Recognition
  4. 2025UWBench: A Comprehensive Vision-Language Benchmark for Underwater Understanding
  5. 2025FishAI 2.0: Marine Fish Image Classification with Multi-modal Few-shot Learning
  6. 2024ODYSSEE: Oyster Detection Yielded by Sensor Systems on Edge Electronics
  7. 2026Teach a Molmo2Fish: Towards interactive fish tracking with natural language guidance
  8. 2025AquaticCLIP: A Vision-Language Foundation Model for Underwater Scene Analysis