mlsanityData to 14 Oct 2026

Hespi: A pipeline for automatically detecting information from hebarium specimen sheets

arXiv 2410.08740 ↗First posted 11 Oct 2024cs.CV cs.AI cs.IRcited by 1

Not on the map. Why?

Abstract (arXiv)

Specimen-associated biodiversity data are crucial for biological, environmental, and conservation sciences. A rate shift is needed to extract data from specimen images efficiently, moving beyond human-mediated transcription. We developed `Hespi' (HErbarium Specimen sheet PIpeline) using advanced computer vision techniques to extract pre-catalogue data from primary specimen labels on herbarium specimens. Hespi integrates two object detection models: one for detecting the components of the sheet and another for fields on the primary primary specimen label. It classifies labels as printed, typed, handwritten, or mixed and uses Optical Character Recognition (OCR) and Handwritten Text Recognition (HTR) for extraction. The text is then corrected against authoritative taxon databases and refined using a multimodal Large Language Model (LLM). Hespi accurately detects and extracts text from specimen sheets across international herbaria, and its modular design allows users to train and integrate custom models.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 6 of its 72 references that are in the map. First posted on arXiv 11 Oct 2024.

Builds on

6 of 72 references.

References · 6

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  5. 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
  6. 2024Notes on Applicability of GPT-4 to Document Understandingcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Automated pipeline for herbarium label digitizationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Towards Context-Rich Automated Biodiversity Assessments: Deriving AI-Powered Insights from Camera Trap Data
  2. 2025Taxonomic Reasoning for Rare Arthropods: Combining Dense Image Captioning and RAG for Interpretable Classification
  3. 2025Visual Species Recognition with Large Multimodal Models as Post-Hoc Correctors
  4. 2026Can Edge-Deployable Vision-Language Models Identify Species?
  5. 2025BarkXAI: A Lightweight Post-Hoc Explainable Method for Tree Species Classification with Quantifiable Concepts
  6. 2026Benchmarking Vision-Language Models for Microscopic Plant Image Understanding
  7. 2026DeepTaxon: An Interpretable Retrieval-Augmented Multimodal Framework for Unified Species Identification and Discovery
  8. 2023Species196: A One-Million Semi-supervised Dataset for Fine-grained Species Recognition