Million-scale multimodal pollen microscopy with expert-guided foundation models
Not on the map. Why?
Abstract (arXiv)
Automated pollen identification from microscopy remains a bottleneck in aerobiology, palaeoecology and biodiversity monitoring, because scalable systems must generalise across specimen preparation, scanner settings and geographic origins while retaining palynological interpretability. To address this gap, we present a million-scale multimodal pollen microscopy resource, Pollen AI Atlas, assembled from pure-species whole-slide bright-field images spanning four geographic origins, four scanner settings, 45 genera, and one family-only taxon across 31 botanical families. Seeded by one manually selected exemplar per source slide, token-level mining and filtering produced 1,511,390 released grain detections with 99.6% proposal precision in expert-curated test regions. Each detection was paired with machine-generated grain-level morphological captions from five open-weight vision--language models, guided by expert-verified palynological anchors, yielding structured descriptions of aperture systems, wall ornamentation, shape and size. Among the evaluated models, Gemma4 provided the most controlled primary caption set, combining tight length control, no detected taxon-name or numeric-size leakage and the strongest text-retrieval performance. Baseline benchmarks with frozen visual features reached 88.16% top-1 accuracy, while cross-regional retrieval showed that caption-derived text embeddings remained robust when image similarity degraded (mAP@20 0.811 versus 0.262). Released data, annotations, captions, splits, code, and weights provide a benchmark for pollen recognition, cross-regional domain adaptation and domain-specific multimodal microscopy learning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 53 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
11 of 53 references.
References · 11
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2021Towards Open World Object Detectioncited by 297
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 156
- 2025BIOMEDICA: An Open Biomedical Image-Caption Archive, Dataset, and Vision-Language Models Derived from Scientific Literaturecited by 34
- 2020Pollen13K: A Large Scale Microscope Pollen Grain Image Datasetcited by 5
Built on by
Not cited yet.