mlsanityData to 7 Oct 2026

Automating Iconclass: LLMs and RAG for Large-Scale Classification of Religious Woodcuts

arXiv 2510.19986 ↗First posted 22 Oct 2025cs.IR cs.CVcited by 0

On the map: Retrieval-augmented generation → Multimodal RAG

Abstract (arXiv)

This paper presents a novel methodology for classifying early modern religious images by using Large Language Models (LLMs) and vector databases in combination with Retrieval-Augmented Generation (RAG). The approach leverages the full-page context of book illustrations from the Holy Roman Empire, allowing the LLM to generate detailed descriptions that incorporate both visual and textual elements. These descriptions are then matched to relevant Iconclass codes through a hybrid vector search. This method achieves 87% and 92% precision at five and four levels of classification, significantly outperforming traditional image and keyword-based searches. By employing full-page descriptions and RAG, the system enhances classification accuracy, offering a powerful tool for large-scale analysis of early modern visual archives. This interdisciplinary approach demonstrates the growing potential of LLMs and RAG in advancing research within art history and digital humanities.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 8 of its 22 references that are in the map. First posted on arXiv 22 Oct 2025.

Builds on

8 of 22 references.

References · 8

  1. 2018YOLOv3: An Incremental Improvementcited by 2,652
  2. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
  3. 2020A Data Set and a Convolutional Model for Iconography Classification in Paintingscited by 17
  4. 2017OmniArt: Multi-task Deep Learning for Artistic Data Analysiscited by 16
  5. 2022DEArt: Dataset of European Artcited by 9
  6. 2023SniffyArt: The Dataset of Smelling Personscited by 6
  7. 2021Automatic Modeling of Social Concepts Evoked by Art Images as Multimodal Framescited by 4
  8. 2023Multimodal Search on Iconclass using Vision-Language Pre-Trained Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Benchmarking Vision-Language and Multimodal Large Language Models in Zero-shot and Few-shot Scenarios: A study on Christian Iconography
  2. 2025Studying Illustrations in Manuscripts: An Efficient Deep-Learning Approach
  3. 2026A Visual Classification Dataset and Model Evaluation for Historical Manuscript Illustrations
  4. 2025Provenance Analysis of Archaeological Artifacts via Multimodal RAG Systems
  5. 2024Have Large Vision-Language Models Mastered Art History?
  6. 2026When Simpler Is Better: Evaluating Translation Pipelines for Medieval Latin Manuscripts
  7. 2025Retrieval-Augmented Generation for Natural Language Art Provenance Searches in the Getty Provenance Index
  8. 2026Improving Access to Historical Archives with Real-time RAG-based Systems ↗