mlsanityData to 14 Oct 2026

Multimodal Search on Iconclass using Vision-Language Pre-Trained Models

arXiv 2306.16529 ↗First posted 23 Jun 2023cs.IR cs.AI cs.DLcited by 1

Not on the map. Why?

Abstract (arXiv)

Terminology sources, such as controlled vocabularies, thesauri and classification systems, play a key role in digitizing cultural heritage. However, Information Retrieval (IR) systems that allow to query and explore these lexical resources often lack an adequate representation of the semantics behind the user's search, which can be conveyed through multiple expression modalities (e.g., images, keywords or textual descriptions). This paper presents the implementation of a new search engine for one of the most widely used iconography classification system, Iconclass. The novelty of this system is the use of a pre-trained vision-language model, namely CLIP, to retrieve and explore Iconclass concepts using visual or textual queries.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 2 of its 5 references that are in the map. First posted on arXiv 23 Jun 2023.

Builds on

2 of 5 references.

References · 2

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2017Billion-scale similarity search with GPUscited by 2,497

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Automating Iconclass: LLMs and RAG for Large-Scale Classification of Religious Woodcutscited by 1

Similar, not cited

Close in wording, no citation either way

  1. 2025Benchmarking Vision-Language and Multimodal Large Language Models in Zero-shot and Few-shot Scenarios: A study on Christian Iconography
  2. 2024Explainable Search and Discovery of Visual Cultural Heritage Collections with Multimodal Large Language Models
  3. 2021Iconographic Image Captioning for Artworks
  4. 2024Have Large Vision-Language Models Mastered Art History?
  5. 2026A Visual Classification Dataset and Model Evaluation for Historical Manuscript Illustrations
  6. 2026KARAMEL: Knowledge-Aware Ranking for Multimodal Entity Linking in the Arts via Heterogeneous Graphs
  7. 2025Provenance Analysis of Archaeological Artifacts via Multimodal RAG Systems
  8. 2023Diffusion Based Augmentation for Captioning and Retrieval in Cultural Heritage