Can Edge-Deployable Vision-Language Models Identify Species?
On the map: Multimodal LLMs / vision-language models → Agricultural vision-language models
Abstract (arXiv)
Camera traps often run in the field on edge hardware with limited or no connectivity, making small, locally-deployable vision-language models (VLMs) -- not frontier-scale ones -- the practically relevant class to evaluate for species identification. We test whether models in this deployment-relevant 2--8B range carry genuine taxonomic knowledge, evaluating four such VLMs (Qwen3-VL 2B/4B/8B, Gemma3 4B) against the domain-specific specialist BioCLIP (300M parameters) on a 96-species task, comparing clean iNaturalist photographs against camera-trap imagery from 6 LILA.science collections, on two independently-sampled evaluation sets. All models identify species far above chance, but every model -- general-purpose or specialist -- degrades sharply on field imagery (domain gaps of 9.6--26.6 percentage points, consistent across taxonomic levels and both evaluation sets), indicating the degradation reflects general image legibility rather than fine-grained discrimination failure. BioCLIP substantially outperforms every VLM tested (by 33.2--59.2 percentage points across an expanded 200-image sample for every model) despite its far smaller size, suggesting the gap reflects specialized training data rather than model scale; yet BioCLIP's own domain gap (18.0 points) is statistically indistinguishable from the best VLM's (22.3 points), suggesting the clean-to-field degradation itself is a property of the image-quality shift rather than a general-purpose-model weakness. Under open-set prompting, 5.9--9.6% of responses are syntactically valid but taxonomically nonexistent species names; the relative fabrication-rate ranking across models replicates exactly across both evaluation sets, a more robust finding than any single point estimate.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agricultural vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 4 of its 12 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
4 of 12 references.
References · 4
- 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 161
- 2023Multimodal Foundation Models for Zero-shot Animal Species Recognition in Camera Trap Imagescited by 13
- 2025Are We There Yet? A Measurement Study of Efficiency for LLM Applications on Mobile Devicescited by 4
- 2026Future of Edge AI in biodiversity monitoringcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026trACT: temporal revelation Airborne Camera Trapcited by 0
- 2026trACT: temporal revelation Airborne Camera Trap7 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2026Scout: Open-World Species Recognition on the Edge
- 2026TaxaAdapter: Vision Taxonomy Models are Key to Fine-grained Image Generation over the Tree of Life
- 2025Visual Species Recognition with Large Multimodal Models as Post-Hoc Correctors
- 2024VLM4Bio: A Benchmark Dataset to Evaluate Pretrained Vision-Language Models for Trait Discovery from Biological Images
- 2024Towards Context-Rich Automated Biodiversity Assessments: Deriving AI-Powered Insights from Camera Trap Data
- 2026RealBirdID: Benchmarking Bird Species Identification in the Era of MLLMs
- 2026Evaluation of Vision-Language Models Across Diverse Coastal Environments
- 2026IchthyoNoma: Nomenclature and Context Sensitivity of Zero-Shot Biological Vision--Language Models for Bangladeshi Freshwater Fish Recognition