A multi-modal dataset for insect biodiversity with imagery and DNA at the trap and individual level
Not on the map. Why?
Abstract (arXiv)
Insects comprise millions of species, many experiencing severe population declines under environmental and habitat changes. High-throughput approaches are crucial for accelerating our understanding of insect diversity, with DNA barcoding and high-resolution imaging showing strong potential for automatic taxonomic classification. However, most image-based approaches rely on individual specimen data, unlike the unsorted bulk samples collected in large-scale ecological surveys. We present the Mixed Arthropod Sample Segmentation and Identification (MassID45) dataset for training automatic classifiers of bulk insect samples. It uniquely combines molecular and imaging data at both the unsorted sample level and the full set of individual specimens. Human annotators, supported by an AI-assisted tool, performed two tasks on bulk images: creating segmentation masks around each individual arthropod and assigning taxonomic labels to over 17 000 specimens. Combining the taxonomic resolution of DNA barcodes with precise abundance estimates of bulk images holds great potential for rapid, large-scale characterization of insect communities. This dataset pushes the boundaries of tiny object detection and instance segmentation, fostering innovation in both ecological and machine learning research.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 63 references that are in the map. First posted on arXiv 9 Jul 2025.
Builds on
23 of 63 references.
References · 23
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023Segment Anythingcited by 8,234
- 2017Mask R-CNNcited by 7,277
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 344
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 204
- 2017Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Ratescited by 199
11 more
- 2019iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Imagescited by 197
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 187
- 2021OW-DETR: Open-world Detection Transformercited by 129
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2022Slicing Aided Hyper Inference and Fine-tuning for Small Object Detectioncited by 105
- 2023A Step Towards Worldwide Biodiversity Assessment: The BIOSCAN-1M Insect Datasetcited by 30
- 2024BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversitycited by 24
- 2023Object Detection with Transformers: A Reviewcited by 22
- 2024CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scalecited by 18
- 2023Transformers in Small Object Detection: A Benchmark and Survey of State-of-the-Artcited by 15
- 2024BOLD v4: A Centralized Bioinformatics Platform for DNA-based Biodiversity Datacited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025BioAutoML-NAS: An End-to-End AutoML Framework for Multimodal Insect Classification via Neural Architecture Search on Large-Scale Biodiversity Datacited by 0
- 2026A continental-scale dataset of ground beetles with high-resolution images and validated morphological trait measurementscited by 0
- 2026Colour Extraction Pipeline for Odonates using Computer Visioncited by 0
- 2026Colour Extraction Pipeline for Odonates using Computer Vision20 Apr 2026
- 2026A continental-scale dataset of ground beetles with high-resolution images and validated morphological trait measurements14 Jan 2026
- 2025BioAutoML-NAS: An End-to-End AutoML Framework for Multimodal Insect Classification via Neural Architecture Search on Large-Scale Biodiversity Data7 Oct 2025