Lessons and Open Questions from a Unified Study of Camera-Trap Species Recognition Over Time
Not on the map. Why?
Abstract (arXiv)
Camera traps are vital for large-scale biodiversity monitoring, yet accurate automated analysis remains challenging due to diverse deployment environments. While the computer vision community has mostly framed this challenge as cross-domain generalization, this perspective overlooks a primary challenge faced by ecological practitioners: maintaining reliable recognition at the fixed site over time, where the dynamic nature of ecosystems introduces profound temporal shifts in both background and animal distributions. To bridge this gap, we present the first unified study of camera-trap species recognition over time. We introduce a realistic benchmark comprising 546 camera traps with a streaming protocol that evaluates models over chronologically ordered intervals. Our end-user-centric study yields four key findings. (1) Biological foundation models (e.g., BioCLIP 2) underperform at numerous sites even in initial intervals, underscoring the necessity of site-specific adaptation. (2) Adaptation is challenging under realistic evaluation: when models are updated using past data and evaluated on future intervals (mirrors real deployment lifecycles), naive adaptation can even degrade below zero-shot performance. (3) We identify two drivers of this difficulty: severe class imbalance and pronounced temporal shift in both species distribution and backgrounds between consecutive intervals. (4) We find that effective integration of model-update and post-processing techniques can largely improve accuracy, though a gap from the upper bounds remains. Finally, we highlight critical open questions, such as predicting when zero-shot models will succeed at a new site and determining whether/when model updates are necessary. Our benchmark and analysis provide actionable deployment guidelines for ecological practitioners while establishing new directions for future research in vision and machine learning.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 43 of its 73 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
43 of 73 references.
References · 43
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2021Robust fine-tuning of zero-shot modelscited by 797
- 2021Domain Generalization: A Surveycited by 764
- 2018Recognition in Terra Incognitacited by 658
- 2019Gradient based sample selection for online continual learningcited by 571
31 more
- 2021Deep Long-Tailed Learning: A Surveycited by 417
- 2020Balanced Meta-Softmax for Long-Tailed Visual Recognitioncited by 400
- 2020A Brief Review of Domain Adaptationcited by 288
- 2021Online Continual Learning in Image Classification: An Empirical Surveycited by 245
- 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 161
- 2021Supervised Contrastive Replay: Revisiting the Nearest Class Mean Classifier in Online Class-Incremental Continual Learningcited by 141
- 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 130
- 2021Extending the WILDS Benchmark for Unsupervised Adaptationcited by 86
- 2021The iWildCam 2021 Competition Datasetcited by 77
- 2020Identifying and Compensating for Feature Deviation in Imbalanced Deep Learningcited by 76
- 2022Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillationcited by 72
- 2022Visual Query Tuning: Towards Effective Usage of Intermediate Representations for Parameter and Memory Efficient Transfer Learningcited by 57
- 2025BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learningcited by 50
- 2024Make Continual Learning Stronger via C-Flatcited by 35
- 2024DPCore: Dynamic Prompt Coreset for Continual Test-Time Adaptationcited by 33
- 2021Procrustean Training for Imbalanced Deep Learningcited by 24
- 2024Fine-Tuning is Fine, if Calibratedcited by 24
- 2024OT-VP: Optimal Transport-guided Visual Prompting for Test-Time Adaptationcited by 17
- 2024Lessons and Insights from a Unifying Study of Parameter-Efficient Fine-Tuning (PEFT) in Visual Recognitioncited by 16
- 2019The iWildCam 2018 Challenge Datasetcited by 14
- 2023Multimodal Foundation Models for Zero-shot Animal Species Recognition in Camera Trap Imagescited by 13
- 2023Automated wildlife image classification: An active learning tool for ecological applicationscited by 11
- 2025Continual Unlearning for Text-to-Image Diffusion Models: A Regularization Perspectivecited by 10
- 2025ZeroFlow: Overcoming Catastrophic Forgetting is Easier than You Thinkcited by 9
- 2023Holistic Transfer: Towards Non-Disruptive Fine-Tuning with Partial Target Datacited by 7
- 2024CATALOG: A Camera Trap Language-guided Contrastive Learning Modelcited by 6
- 2025Revisiting semi-supervised learning in the era of foundation modelscited by 6
- 2025AVA-Bench: Atomic Visual Ability Benchmark for Vision Foundation Modelscited by 5
- 2024Deep learning-based ecological analysis of camera trap images is impacted by training data quality and quantitycited by 3
- 2026Revisiting Model Stitching In the Foundation Model Eracited by 2
- 2021Two-phase training mitigates class imbalance for camera trap image classification with CNNscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.