mlsanityData to 7 Oct 2026

Focus on the Positives: Self-Supervised Learning for Biodiversity Monitoring

arXiv 2108.06435 ↗First posted 14 Aug 2021cs.CV cs.LGcited by 16

Not on the map. Why?

Abstract (arXiv)

We address the problem of learning self-supervised representations from unlabeled image collections. Unlike existing approaches that attempt to learn useful features by maximizing similarity between augmented versions of each input image or by speculatively picking negative samples, we instead also make use of the natural variation that occurs in image collections that are captured using static monitoring cameras. To achieve this, we exploit readily available context data that encodes information such as the spatial and temporal relationships between the input images. We are able to learn representations that are surprisingly effective for downstream supervised classification, by first identifying high probability positive pairs at training time, i.e. those images that are likely to depict the same visual concept. For the critical task of global biodiversity monitoring, this results in image features that can be adapted to challenging visual species classification tasks with limited human supervision. We present results on four different camera trap image collections, across three different families of self-supervised learning methods, and show that careful image selection at training time results in superior performance compared to existing baselines such as conventional self-supervised training and transfer learning.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 45 of its 63 references that are in the map. First posted on arXiv 14 Aug 2021.

Builds on

45 of 63 references.

References · 45

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  7. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  8. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  9. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  10. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  11. 2020Supervised Contrastive Learningcited by 2,803
  12. 2018SlowFast Networks for Video Recognitioncited by 1,862
33 more
  1. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
  2. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
  3. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  4. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
  5. 2019Contrastive Multiview Codingcited by 1,297
  6. 2016Colorful Image Colorizationcited by 1,113
  7. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
  8. 2018Recognition in Terra Incognitacited by 655
  9. 2020Contrastive Learning with Hard Negative Samplescited by 619
  10. 2017Time-Contrastive Networks: Self-Supervised Learning from Videocited by 453
  11. 2015Unsupervised Learning of Video Representations using LSTMscited by 434
  12. 2020Hard Negative Mixing for Contrastive Learningcited by 399
  13. 2020Spatiotemporal Contrastive Video Representation Learningcited by 372
  14. 2020Debiased Contrastive Learningcited by 354
  15. 2017Functional Map of the Worldcited by 338
  16. 2014Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networkscited by 299
  17. 2018Long-Term Feature Banks for Detailed Video Understandingcited by 239
  18. 2017Unsupervised Representation Learning by Sorting Sequencescited by 219
  19. 2016Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Predictioncited by 217
  20. 2020How Well Do Self-Supervised Models Transfer?cited by 213
  21. 2019Local Aggregation for Unsupervised Learning of Visual Embeddingscited by 204
  22. 2019Scaling and Benchmarking Self-Supervised Visual Representation Learningcited by 201
  23. 2020Geography-Aware Self-Supervised Learningcited by 190
  24. 2021Benchmarking Representation Learning for Natural World Image Collectionscited by 167
  25. 2020Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biasescited by 143
  26. 2018Tile2Vec: Unsupervised representation learning for spatially distributed datacited by 109
  27. 2019Presence-Only Geographical Priors for Fine-Grained Image Classificationcited by 109
  28. 2019Self-supervised Spatio-temporal Representation Learning for Videos by Predicting Motion and Appearance Statisticscited by 92
  29. 2019Efficient Pipeline for Camera Trap Image Reviewcited by 79
  30. 2020A survey on Semi-, Self- and Unsupervised Learning for Image Classificationcited by 55
  31. 2019Context R-CNN: Long Term Temporal Context for Per-Camera Object Detectioncited by 45
  32. 2019Geo-Aware Networks for Fine-Grained Recognitioncited by 44
  33. 2015Improving Image Classification with Location Contextcited by 33

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 5; 2023: 3; 2024: 3; 2025: 3; 2026: 1.

16 papers.

Sort:

By area:

  1. 2021Extending the WILDS Benchmark for Unsupervised Adaptationcited by 85
  2. 2022SVL-Adapter: Self-Supervised Adapter for Vision-Language Pretrained Modelscited by 34
  3. 2022Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive Learningcited by 22
  4. 2024Contrastive ground-level image and remote sensing pre-training improves representation learning for natural world imagerycited by 10
  5. 2023When Less is Enough: Positive and Unlabeled Learning Model for Vulnerability Detectioncited by 8
  6. 2024Pose-Aware Self-Supervised Learning with Viewpoint Trajectory Regularizationcited by 7
  7. 2025Foundation Models for Environmental Science: A Survey of Emerging Frontierscited by 4
  8. 2026Vision Transformers for Zero-Shot Clustering of Animal Images: A Comparative Benchmarking Studycited by 4
  9. 2022Boosting Automatic COVID-19 Detection Performance with Self-Supervised Learning and Batch Knowledge Ensemblingcited by 3
  10. 2024Deep learning-based ecological analysis of camera trap images is impacted by training data quality and quantitycited by 3
  11. 2025A Survey of Foundation Models for Environmental Sciencecited by 3
  12. 2023Keep It Simple: Fault Tolerance Evaluation of Federated Learning with Unreliable Clientscited by 2
4 more
  1. 2022Matching Multiple Perspectives for Efficient Representation Learningcited by 1
  2. 2022Contrastive pretraining for semantic segmentation is robust to noisy positive pairscited by 0
  3. 2023Nine tips for ecologists using machine learningcited by 0
  4. 2025Leveraging Spatial Context for Positive Pair Sampling in Histopathology Image Representation Learningcited by 0