Focus on the Positives: Self-Supervised Learning for Biodiversity Monitoring
Not on the map. Why?
Abstract (arXiv)
We address the problem of learning self-supervised representations from unlabeled image collections. Unlike existing approaches that attempt to learn useful features by maximizing similarity between augmented versions of each input image or by speculatively picking negative samples, we instead also make use of the natural variation that occurs in image collections that are captured using static monitoring cameras. To achieve this, we exploit readily available context data that encodes information such as the spatial and temporal relationships between the input images. We are able to learn representations that are surprisingly effective for downstream supervised classification, by first identifying high probability positive pairs at training time, i.e. those images that are likely to depict the same visual concept. For the critical task of global biodiversity monitoring, this results in image features that can be adapted to challenging visual species classification tasks with limited human supervision. We present results on four different camera trap image collections, across three different families of self-supervised learning methods, and show that careful image selection at training time results in superior performance compared to existing baselines such as conventional self-supervised training and transfer learning.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 45 of its 63 references that are in the map. First posted on arXiv 14 Aug 2021.
Builds on
45 of 63 references.
References · 45
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2020Supervised Contrastive Learningcited by 2,803
- 2018SlowFast Networks for Video Recognitioncited by 1,862
33 more
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2019Contrastive Multiview Codingcited by 1,297
- 2016Colorful Image Colorizationcited by 1,113
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
- 2018Recognition in Terra Incognitacited by 655
- 2020Contrastive Learning with Hard Negative Samplescited by 619
- 2017Time-Contrastive Networks: Self-Supervised Learning from Videocited by 453
- 2015Unsupervised Learning of Video Representations using LSTMscited by 434
- 2020Hard Negative Mixing for Contrastive Learningcited by 399
- 2020Spatiotemporal Contrastive Video Representation Learningcited by 372
- 2020Debiased Contrastive Learningcited by 354
- 2017Functional Map of the Worldcited by 338
- 2014Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networkscited by 299
- 2018Long-Term Feature Banks for Detailed Video Understandingcited by 239
- 2017Unsupervised Representation Learning by Sorting Sequencescited by 219
- 2016Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Predictioncited by 217
- 2020How Well Do Self-Supervised Models Transfer?cited by 213
- 2019Local Aggregation for Unsupervised Learning of Visual Embeddingscited by 204
- 2019Scaling and Benchmarking Self-Supervised Visual Representation Learningcited by 201
- 2020Geography-Aware Self-Supervised Learningcited by 190
- 2021Benchmarking Representation Learning for Natural World Image Collectionscited by 167
- 2020Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biasescited by 143
- 2018Tile2Vec: Unsupervised representation learning for spatially distributed datacited by 109
- 2019Presence-Only Geographical Priors for Fine-Grained Image Classificationcited by 109
- 2019Self-supervised Spatio-temporal Representation Learning for Videos by Predicting Motion and Appearance Statisticscited by 92
- 2019Efficient Pipeline for Camera Trap Image Reviewcited by 79
- 2020A survey on Semi-, Self- and Unsupervised Learning for Image Classificationcited by 55
- 2019Context R-CNN: Long Term Temporal Context for Per-Camera Object Detectioncited by 45
- 2019Geo-Aware Networks for Fine-Grained Recognitioncited by 44
- 2015Improving Image Classification with Location Contextcited by 33
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 3; 2024: 3; 2025: 3; 2026: 1.
16 papers.
Sort:
By area:
- 2021Extending the WILDS Benchmark for Unsupervised Adaptationcited by 85
- 2022SVL-Adapter: Self-Supervised Adapter for Vision-Language Pretrained Modelscited by 34
- 2022Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive Learningcited by 22
- 2024Contrastive ground-level image and remote sensing pre-training improves representation learning for natural world imagerycited by 10
- 2023When Less is Enough: Positive and Unlabeled Learning Model for Vulnerability Detectioncited by 8
- 2024Pose-Aware Self-Supervised Learning with Viewpoint Trajectory Regularizationcited by 7
- 2025Foundation Models for Environmental Science: A Survey of Emerging Frontierscited by 4
- 2026Vision Transformers for Zero-Shot Clustering of Animal Images: A Comparative Benchmarking Studycited by 4
- 2022Boosting Automatic COVID-19 Detection Performance with Self-Supervised Learning and Batch Knowledge Ensemblingcited by 3
- 2024Deep learning-based ecological analysis of camera trap images is impacted by training data quality and quantitycited by 3
- 2025A Survey of Foundation Models for Environmental Sciencecited by 3
- 2023Keep It Simple: Fault Tolerance Evaluation of Federated Learning with Unreliable Clientscited by 2
4 more
- 2022Matching Multiple Perspectives for Efficient Representation Learningcited by 1
- 2022Contrastive pretraining for semantic segmentation is robust to noisy positive pairscited by 0
- 2023Nine tips for ecologists using machine learningcited by 0
- 2025Leveraging Spatial Context for Positive Pair Sampling in Histopathology Image Representation Learningcited by 0
- 2026Vision Transformers for Zero-Shot Clustering of Animal Images: A Comparative Benchmarking Study3 Feb 2026
- 2025Foundation Models for Environmental Science: A Survey of Emerging Frontiers5 Apr 2025
- 2025Leveraging Spatial Context for Positive Pair Sampling in Histopathology Image Representation Learning7 Mar 2025
- 2025A Survey of Foundation Models for Environmental Science5 Mar 2025
- 2024Contrastive ground-level image and remote sensing pre-training improves representation learning for natural world imagery28 Sep 2024
- 2024Deep learning-based ecological analysis of camera trap images is impacted by training data quality and quantity26 Aug 2024
- 2024Pose-Aware Self-Supervised Learning with Viewpoint Trajectory Regularization22 Mar 2024
- 2023When Less is Enough: Positive and Unlabeled Learning Model for Vulnerability Detection21 Aug 2023
- 2023Nine tips for ecologists using machine learning17 May 2023
- 2023Keep It Simple: Fault Tolerance Evaluation of Federated Learning with Unreliable Clients16 May 2023
- 2022Boosting Automatic COVID-19 Detection Performance with Self-Supervised Learning and Batch Knowledge Ensembling19 Dec 2022
- 2022Contrastive pretraining for semantic segmentation is robust to noisy positive pairs24 Nov 2022
4 more
- 2022Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive Learning17 Oct 2022
- 2022SVL-Adapter: Self-Supervised Adapter for Vision-Language Pretrained Models7 Oct 2022
- 2022Matching Multiple Perspectives for Efficient Representation Learning16 Aug 2022
- 2021Extending the WILDS Benchmark for Unsupervised Adaptation9 Dec 2021
- 2021Extending the WILDS Benchmark for Unsupervised Adaptationcited by 85
- 2022Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive Learningcited by 22
- 2024Contrastive ground-level image and remote sensing pre-training improves representation learning for natural world imagerycited by 10
- 2023When Less is Enough: Positive and Unlabeled Learning Model for Vulnerability Detectioncited by 8
- 2024Pose-Aware Self-Supervised Learning with Viewpoint Trajectory Regularizationcited by 7
- 2025Foundation Models for Environmental Science: A Survey of Emerging Frontierscited by 4
- 2026Vision Transformers for Zero-Shot Clustering of Animal Images: A Comparative Benchmarking Studycited by 4
- 2022Boosting Automatic COVID-19 Detection Performance with Self-Supervised Learning and Batch Knowledge Ensemblingcited by 3
- 2024Deep learning-based ecological analysis of camera trap images is impacted by training data quality and quantitycited by 3
- 2025A Survey of Foundation Models for Environmental Sciencecited by 3
- 2023Keep It Simple: Fault Tolerance Evaluation of Federated Learning with Unreliable Clientscited by 2
- 2022Matching Multiple Perspectives for Efficient Representation Learningcited by 1
12 most cited of 15 All 15 (JSON)
- 2026Vision Transformers for Zero-Shot Clustering of Animal Images: A Comparative Benchmarking Study3 Feb 2026
- 2025Foundation Models for Environmental Science: A Survey of Emerging Frontiers5 Apr 2025
- 2025Leveraging Spatial Context for Positive Pair Sampling in Histopathology Image Representation Learning7 Mar 2025
- 2025A Survey of Foundation Models for Environmental Science5 Mar 2025
- 2024Contrastive ground-level image and remote sensing pre-training improves representation learning for natural world imagery28 Sep 2024
- 2024Deep learning-based ecological analysis of camera trap images is impacted by training data quality and quantity26 Aug 2024
- 2024Pose-Aware Self-Supervised Learning with Viewpoint Trajectory Regularization22 Mar 2024
- 2023When Less is Enough: Positive and Unlabeled Learning Model for Vulnerability Detection21 Aug 2023
- 2023Nine tips for ecologists using machine learning17 May 2023
- 2023Keep It Simple: Fault Tolerance Evaluation of Federated Learning with Unreliable Clients16 May 2023
- 2022Boosting Automatic COVID-19 Detection Performance with Self-Supervised Learning and Batch Knowledge Ensembling19 Dec 2022
- 2022Contrastive pretraining for semantic segmentation is robust to noisy positive pairs24 Nov 2022
12 newest of 15 All 15 (JSON)