Multi-label classification for multi-temporal, multi-spatial coral reef condition monitoring using vision foundation model with adapter learning
Not on the map. Why?
Abstract (arXiv)
Coral reef ecosystems provide essential ecosystem services, but face significant threats from climate change and human activities. Although advances in deep learning have enabled automatic classification of coral reef conditions, conventional deep models struggle to achieve high performance when processing complex underwater ecological images. Vision foundation models, known for their high accuracy and cross-domain generalizability, offer promising solutions. However, fine-tuning these models requires substantial computational resources and results in high carbon emissions. To address these challenges, adapter learning methods such as Low-Rank Adaptation (LoRA) have emerged as a solution. This study introduces an approach integrating the DINOv2 vision foundation model with the LoRA fine-tuning method. The approach leverages multi-temporal field images collected through underwater surveys at 15 dive sites at Koh Tao, Thailand, with all images labeled according to universal standards used in citizen science-based conservation programs. The experimental results demonstrate that the DINOv2-LoRA model achieved superior accuracy, with a match ratio of 64.77%, compared to 60.34% achieved by the best conventional model. Furthermore, incorporating LoRA reduced the trainable parameters from 1,100M to 5.91M. Transfer learning experiments conducted under different temporal and spatial settings highlight the exceptional generalizability of DINOv2-LoRA across different seasons and sites. This study is the first to explore the efficient adaptation of foundation models for multi-label classification of coral reef conditions under multi-temporal and multi-spatial settings. The proposed method advances the classification of coral reef conditions and provides a tool for monitoring, conserving, and managing coral reef ecosystems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 159 references that are in the map. First posted on arXiv 29 Mar 2025.
Builds on
30 of 159 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016Densely Connected Convolutional Networkscited by 6,720
18 more
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,329
- 2022Continual Test-Time Domain Adaptationcited by 525
- 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 403
- 2022Parameter-free Online Test-time Adaptationcited by 189
- 2023Towards Geospatial Foundation Models via Continual Pretrainingcited by 109
- 2016Understanding data augmentation for classification: when to warp?cited by 74
- 2023Long-Tail Learning with Foundation Model: Heavy Fine-Tuning Hurtscited by 58
- 2021Global-Local Transformer for Brain Age Estimationcited by 34
- 2018Towards Highly Accurate Coral Texture Images Classification Using Deep Convolutional Neural Networks and Data Augmentationcited by 11
- 2024Exploring the Benefits of Vision Foundation Models for Unsupervised Domain Adaptationcited by 11
- 2024Infrared Small Target Detection in Satellite Videos: A New Dataset and A Novel Recurrent Feature Refinement Frameworkcited by 9
- 2023Scalable Semantic 3D Mapping of Coral Reefs with Deep Learningcited by 8
- 2024Deep learning for multi-label classification of coral conditions in the Indo-Pacific via underwater photogrammetrycited by 2
- 2024Hierarchical Multi-Label Classification with Missing Information for Benthic Habitat Imagerycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.