AmalthAI: An Open-Source Computer Vision Platform for Cultural Heritage
Not on the map. Why?
Abstract (arXiv)
Computer vision (CV) and machine learning (ML) offer new tools for cultural heritage (CH) artifact analysis, but the CV/ML pipeline remains largely inaccessible to CH domain experts, who lack the background to configure, train, or assess models. We present AmalthAI, an open-source CV platform that bridges this gap, enabling non-ML CH experts to independently produce and validate archaeologically meaningful findings. The interface covers dataset management, training, and inference for classification, segmentation, and object detection, with Kubeflow and Katib handling scalable training and hyperparameter search. Grad-CAM localizes the image region behind a prediction, and a vision-language model (VLM) adds a text description of it for expert review. Since archaeological data is often state-owned or rights-encumbered and cannot leave institutional custody, AmalthAI's self-hostable deployment ensures sensitive data is kept within premises. We test the platform on an archaeological use case built on a custom dataset of clay textile imprints, where CH experts trained and validated segmentation, and classification models for hypothesis testing. We provide the implementation code at https://github.com/TEXTaiLES/AmalthAI.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 51 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
19 of 51 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2023Segment Anythingcited by 8,234
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2022A ConvNet for the 2020scited by 3,579
7 more
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,136
- 2022Machine Learning Operations (MLOps): Overview, Definition, and Architecturecited by 128
- 2026Ultralytics YOLO26: Unified Real-Time End-to-End Vision Modelscited by 57
- 2018Deep Learning Architect: Classification for Architectural Design through the Eye of Artificial Intelligencecited by 7
- 2024Multimodal Metadata Assignment for Cultural Heritage Artifactscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Provenance Analysis of Archaeological Artifacts via Multimodal RAG Systems
- 2024An archaeological Catalog Collection Method Based on Large Vision-Language Models
- 2023Knowledge-Aware Artifact Image Synthesis with LLM-Enhanced Prompting and Multi-Source Supervision
- 2026Tanawpamana: Benchmarking Vision-Language Models on Philippine Cultural Heritage Sites
- 2026On the Cultural Anachronism and Temporal Reasoning in Vision Language Models
- 2024Crossroads of Continents: Automated Artifact Extraction for Cultural Adaptation with Large Multimodal Models
- 2026Synthetic Data Augmentation for Multi-Task Chinese Porcelain Classification: A Stable Diffusion Approach
- 2025Multi-Modal Semantic Parsing for the Interpretation of Tombstone Inscriptions