Application of deep learning to camera trap data for ecologists in planning / engineering -- Can captivity imagery train a model which generalises to the wild?
Not on the map. Why?
Abstract (arXiv)
Understanding the abundance of a species is the first step towards understanding both its long-term sustainability and the impact that we may be having upon it. Ecologists use camera traps to remotely survey for the presence of specific animal species. Previous studies have shown that deep learning models can be trained to automatically detect and classify animals within camera trap imagery with high levels of confidence. However, the ability to train these models is reliant upon having enough high-quality training data. What happens when the animal is rare or the data sets are non-existent? This research proposes an approach of using images of rare animals in captivity (focusing on the Scottish wildcat) to generate the training dataset. We explore the challenges associated with generalising a model trained on captivity data when applied to data collected in the wild. The research is contextualised by the needs of ecologists in planning/engineering. Following precedents from other research, this project establishes an ensemble for object detection, image segmentation and image classification models which are then tested using different image manipulation and class structuring techniques to encourage model generalisation. The research concludes, in the context of Scottish wildcat, that models trained on captivity imagery cannot be generalised to wild camera trap imagery using existing techniques. However, final model performances based on a two-class model Wildcat vs Not Wildcat achieved an overall accuracy score of 81.6% and Wildcat accuracy score of 54.8% on a test set in which only 1% of images contained a wildcat. This suggests using captivity images is feasible with further research. This is the first research which attempts to generate a training set based on captivity data and the first to explore the development of such models in the context of ecologists in planning/engineering.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 22 of its 43 references that are in the map. First posted on arXiv 24 Nov 2021.
Builds on
22 of 43 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017Mask R-CNNcited by 7,277
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
10 more
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2019Searching for MobileNetV3cited by 1,994
- 2018Recognition in Terra Incognitacited by 658
- 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
- 2019Efficient Pipeline for Camera Trap Image Reviewcited by 79
- 2021The iWildCam 2021 Competition Datasetcited by 77
- 2018Past, Present, and Future Approaches Using Computer Vision for Animal Re-Identification from Camera Trap Datacited by 46
- 2019A deep active learning system for species identification and counting in camera trap imagescited by 44
- 2020NDD20: A large-scale few-shot dolphin dataset for coarse and fine-grained categorisationcited by 24
- 2021The surprising impact of mask-head architecture on novel class segmentationcited by 13
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.