Near-perfect photo-ID of the Hula painted frog with zero-shot deep local-feature matching
Not on the map. Why?
Abstract (arXiv)
Accurate individual identification is essential for monitoring rare amphibians, yet invasive marking is often unsuitable for critically endangered species. We evaluate state-of-the-art computer-vision methods for photographic re-identification of the Hula painted frog (Latonia nigriventer) using 1,233 ventral images from 191 individuals collected during 2013-2020 capture-recapture surveys. We compare deep local-feature matching in a zero-shot setting with deep global-feature embedding models. The local-feature pipeline achieves 98% top-1 closed-set identification accuracy, outperforming all global-feature models; fine-tuning improves the best global-feature model to 60% top-1 (91% top-10) but remains below local matching. To combine scalability with accuracy, we implement a two-stage workflow in which a fine-tuned global-feature model retrieves a short candidate list that is re-ranked by local-feature matching, reducing end-to-end runtime from 6.5-7.8 hours to ~38 minutes while maintaining ~96% top-1 closed-set accuracy on the labeled dataset. Separation of match scores between same- and different-individual pairs supports thresholding for open-set identification, enabling practical handling of novel individuals. We deploy this pipeline as a web application for routine field use, providing rapid, standardized, non-invasive identification to support conservation monitoring and capture-recapture analyses. Overall, in this species, zero-shot deep local-feature matching outperformed global-feature embedding and provides a strong default for photo-identification.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 43 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
14 of 43 references.
References · 14
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Segment Anythingcited by 8,158
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2020A Metric Learning Reality Checkcited by 317
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 120
- 2019Efficient Pipeline for Camera Trap Image Reviewcited by 79
- 2018ArcFace: Additive Angular Margin Loss for Deep Face Recognitioncited by 56
- 2023WildlifeDatasets: An open-source toolkit for animal re-identificationcited by 49
- 2021Perspectives on individual animal identification from biology and computer visioncited by 31
- 2023Are Local Features All You Need for Cross-Domain Visual Place Recognition?cited by 21
- 2024WildFusion: Individual Animal Identification with Calibrated Similarity Fusioncited by 9
2 more
- 2025HotSpotter - Patterned Species Instance Recognitioncited by 8
- 2025All You Need to Know About Training Image Retrieval Modelscited by 1
Built on by
Not cited yet.