A Step Towards Worldwide Biodiversity Assessment: The BIOSCAN-1M Insect Dataset
Not on the map. Why?
Abstract (arXiv)
In an effort to catalog insect biodiversity, we propose a new large dataset of hand-labelled insect images, the BIOSCAN-Insect Dataset. Each record is taxonomically classified by an expert, and also has associated genetic information including raw nucleotide barcode sequences and assigned barcode index numbers, which are genetically-based proxies for species classification. This paper presents a curated million-image dataset, primarily to train computer-vision models capable of providing image-based taxonomic assessment, however, the dataset also presents compelling characteristics, the study of which would be of interest to the broader machine learning community. Driven by the biological nature inherent to the dataset, a characteristic long-tailed class-imbalance distribution is exhibited. Furthermore, taxonomic labelling is a hierarchical classification scheme, presenting a highly fine-grained classification problem at lower levels. Beyond spurring interest in biodiversity research within the machine learning community, progress on creating an image-based taxonomic classifier will also further the ultimate goal of all BIOSCAN research: to lay the foundation for a comprehensive survey of global biodiversity. This paper introduces the dataset and explores the classification task through the implementation and analysis of a baseline classifier.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Builds on 11 of its 66 references that are in the map. First posted on arXiv 19 Jul 2023.
Builds on
11 of 66 references.
References · 11
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 513
- 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 334
- 2021Benchmarking Representation Learning for Natural World Image Collectionscited by 168
- 2021Fine-Grained Zero-Shot Learning with DNA as Side Informationcited by 20
Built on by
Citing papers per year: 2023: 1; 2024: 11; 2025: 15; 2026: 3.
30 papers.
Sort:
By area:
- 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 161
- 2025BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learningcited by 50
- 2024BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversitycited by 24
- 2024BioTrove: A Large Curated Image Dataset Enabling AI for Biodiversitycited by 20
- 2024CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scalecited by 18
- 2025AgMMU: A Comprehensive Agricultural Multimodal Understanding Benchmarkcited by 16
- 2024Fish-Vista: A Multi-Purpose Dataset for Understanding & Identification of Traits from Imagescited by 9
- 2024Insect Identification in the Wild: The AMI Datasetcited by 7
- 2024Hierarchical Conditioning of Diffusion Models Using Tree-of-Life for Studying Species Evolutioncited by 7
- 2024FungiTastic: A multi-modal dataset and benchmark for image categorizationcited by 7
- 2024Reconstructing Animals and the Wildcited by 7
- 2025Insect-Foundation: A Foundation Model and Large Multimodal Dataset for Vision-Language Insect Understandingcited by 7
18 more
- 2025TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generationcited by 7
- 2024An Empirical Study into Clustering of Unseen Datasets with Self-Supervised Encoderscited by 5
- 2025Open-Insect: Benchmarking Open-Set Recognition of Novel Species in Biodiversity Monitoringcited by 3
- 2025A multi-modal dataset for insect biodiversity with imagery and DNA at the trap and individual levelcited by 3
- 2025BioCAP: Exploiting Synthetic Captions Beyond Labels in Biological Foundation Modelscited by 3
- 2024Improving Taxonomic Image-based Out-of-distribution Detection With DNA Barcodescited by 2
- 2024Noisy Ostracods: A Fine-Grained, Imbalanced Real-World Dataset for Benchmarking Robust Machine Learning and Label Correction Methodscited by 1
- 2025TerraIncognita: A Dynamic Benchmark for Species Discovery Using Frontier Modelscited by 1
- 2025ReefNet: A Large-Scale Dataset and Benchmark for Fine-Grained Coral Reef Recognitioncited by 1
- 2025Using Knowledge Graphs to harvest datasets for efficient CLIP model trainingcited by 0
- 2025CrypticBio: A Large Multimodal Dataset for Visually Confusing Biodiversitycited by 0
- 2025AquaMonitor: A multimodal multi-view image sequence dataset for real-life aquatic invertebrate biodiversity monitoringcited by 0
- 2025Hard Samples, Bad Labels: Robust Loss Functions That Know When to Back Offcited by 0
- 2025What You See is (Usually) What You Get: Multimodal Prototype Networks that Abstain from Expensive Modalitiescited by 0
- 2025Dual-Margin Embedding for Fine-Grained Long-Tailed Plant Taxonomycited by 0
- 2026Hierarchy-Guided Multimodal Representation Learning for Taxonomic Inferencecited by 0
- 2026TreeAdapter: Hierarchical Taxonomy-Guided Adapter Composition for Fine-Grained Species Image Generationcited by 0
- 2026Hierarchy-Aware Supervised Uncertainty Estimation for Black-box LLM Taxonomic Reasoningcited by 0
- 2026Hierarchy-Aware Supervised Uncertainty Estimation for Black-box LLM Taxonomic Reasoning24 Aug 2026
- 2026TreeAdapter: Hierarchical Taxonomy-Guided Adapter Composition for Fine-Grained Species Image Generation27 Jul 2026
- 2026Hierarchy-Guided Multimodal Representation Learning for Taxonomic Inference26 Mar 2026
- 2025Dual-Margin Embedding for Fine-Grained Long-Tailed Plant Taxonomy22 Dec 2025
- 2025What You See is (Usually) What You Get: Multimodal Prototype Networks that Abstain from Expensive Modalities24 Nov 2025
- 2025Hard Samples, Bad Labels: Robust Loss Functions That Know When to Back Off20 Nov 2025
- 2025BioCAP: Exploiting Synthetic Captions Beyond Labels in Biological Foundation Models23 Oct 2025
- 2025ReefNet: A Large-Scale Dataset and Benchmark for Fine-Grained Coral Reef Recognition19 Oct 2025
- 2025A multi-modal dataset for insect biodiversity with imagery and DNA at the trap and individual level9 Jul 2025
- 2025TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generation2 Jun 2025
- 2025TerraIncognita: A Dynamic Benchmark for Species Discovery Using Frontier Models29 May 2025
- 2025BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learning29 May 2025
18 more
- 2025AquaMonitor: A multimodal multi-view image sequence dataset for real-life aquatic invertebrate biodiversity monitoring28 May 2025
- 2025CrypticBio: A Large Multimodal Dataset for Visually Confusing Biodiversity16 May 2025
- 2025Using Knowledge Graphs to harvest datasets for efficient CLIP model training5 May 2025
- 2025AgMMU: A Comprehensive Agricultural Multimodal Understanding Benchmark14 Apr 2025
- 2025Open-Insect: Benchmarking Open-Set Recognition of Novel Species in Biodiversity Monitoring3 Mar 2025
- 2025Insect-Foundation: A Foundation Model and Large Multimodal Dataset for Vision-Language Insect Understanding14 Feb 2025
- 2024Noisy Ostracods: A Fine-Grained, Imbalanced Real-World Dataset for Benchmarking Robust Machine Learning and Label Correction Methods3 Dec 2024
- 2024Reconstructing Animals and the Wild27 Nov 2024
- 2024FungiTastic: A multi-modal dataset and benchmark for image categorization24 Aug 2024
- 2024Hierarchical Conditioning of Diffusion Models Using Tree-of-Life for Studying Species Evolution31 Jul 2024
- 2024Fish-Vista: A Multi-Purpose Dataset for Understanding & Identification of Traits from Images10 Jul 2024
- 2024Improving Taxonomic Image-based Out-of-distribution Detection With DNA Barcodes27 Jun 2024
- 2024BioTrove: A Large Curated Image Dataset Enabling AI for Biodiversity25 Jun 2024
- 2024BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversity18 Jun 2024
- 2024Insect Identification in the Wild: The AMI Dataset18 Jun 2024
- 2024An Empirical Study into Clustering of Unseen Datasets with Self-Supervised Encoders4 Jun 2024
- 2024CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scale27 May 2024
- 2023BioCLIP: A Vision Foundation Model for the Tree of Life30 Nov 2023
- 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 161
- 2025BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learningcited by 50
- 2024BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversitycited by 24
- 2024BioTrove: A Large Curated Image Dataset Enabling AI for Biodiversitycited by 20
- 2024CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scalecited by 18
- 2024Fish-Vista: A Multi-Purpose Dataset for Understanding & Identification of Traits from Imagescited by 9
- 2024Insect Identification in the Wild: The AMI Datasetcited by 7
- 2024FungiTastic: A multi-modal dataset and benchmark for image categorizationcited by 7
- 2024Reconstructing Animals and the Wildcited by 7
- 2025Insect-Foundation: A Foundation Model and Large Multimodal Dataset for Vision-Language Insect Understandingcited by 7
- 2024An Empirical Study into Clustering of Unseen Datasets with Self-Supervised Encoderscited by 5
- 2025Open-Insect: Benchmarking Open-Set Recognition of Novel Species in Biodiversity Monitoringcited by 3
12 most cited of 26 All 26 (JSON)
- 2026TreeAdapter: Hierarchical Taxonomy-Guided Adapter Composition for Fine-Grained Species Image Generation27 Jul 2026
- 2026Hierarchy-Guided Multimodal Representation Learning for Taxonomic Inference26 Mar 2026
- 2025Dual-Margin Embedding for Fine-Grained Long-Tailed Plant Taxonomy22 Dec 2025
- 2025What You See is (Usually) What You Get: Multimodal Prototype Networks that Abstain from Expensive Modalities24 Nov 2025
- 2025Hard Samples, Bad Labels: Robust Loss Functions That Know When to Back Off20 Nov 2025
- 2025BioCAP: Exploiting Synthetic Captions Beyond Labels in Biological Foundation Models23 Oct 2025
- 2025ReefNet: A Large-Scale Dataset and Benchmark for Fine-Grained Coral Reef Recognition19 Oct 2025
- 2025A multi-modal dataset for insect biodiversity with imagery and DNA at the trap and individual level9 Jul 2025
- 2025TerraIncognita: A Dynamic Benchmark for Species Discovery Using Frontier Models29 May 2025
- 2025BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learning29 May 2025
- 2025AquaMonitor: A multimodal multi-view image sequence dataset for real-life aquatic invertebrate biodiversity monitoring28 May 2025
- 2025CrypticBio: A Large Multimodal Dataset for Visually Confusing Biodiversity16 May 2025
12 newest of 26 All 26 (JSON)