mlsanityData to 14 Oct 2026

TimeLens: On-Device Artifact Recognition with Retrieval-Augmented Question Answering for the Grand Egyptian Museum

arXiv 2606.13267 ↗First posted 11 Jun 2026cs.CV cs.CL cs.IRcited by 0

On the map: Retrieval-augmented generation → Multimodal RAG

Abstract (arXiv)

TimeLens is an AI-powered bilingual mobile guide for the Grand Egyptian Museum (GEM). Pointing a phone at an exhibit, a visitor sees the artifact recognized in real time and can ask follow-up questions answered in English or Arabic. The work addresses three problems specific to in-gallery deployment: fine-grained visual similarity among 51 catalogued artifacts (many near-identical Ramesside statues), the gap between curated training data and handheld camera conditions, and the risk of an AI guide stating unsupported historical facts. Two engineering contributions are reported. First, an on-device artifact detector was developed through a data-quality-driven iteration study -- from foundation-model auto-annotation (YOLO-World), through spatial label-cleaning rules, to a fully hand-annotated dataset -- isolating label quality as the decisive factor: the final YOLOv8n model resolves every previously failing class while remaining a 5.97 MB TensorFlow Lite asset that runs in real time on a mid-range phone ([email protected] = 0.995, [email protected]:0.95 = 0.924). Second, a bilingual Retrieval-Augmented Generation (RAG) guide, grounded in a 108-record ChromaDB knowledge base, was benchmarked across seven candidate language models, with Gemma 4 E2B (Q4 K M) selected; ten targeted optimizations reduce end-to-end latency from over 30 s to approximately 10 s. Both subsystems are integrated in a production Flutter application with bilingual interface, museum location gating, and text-to-speech support.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 3 of its 16 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

3 of 16 references.

References · 3

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
  3. 2025Teaching LLMs to See and Guide: Context-Aware Real-Time Assistance in Augmented Realitycited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Understanding Museum Exhibits using Vision-Language Reasoning
  2. 2025Time Travel: A Comprehensive Benchmark to Evaluate LMMs on Historical and Cultural Artifacts
  3. 2026AmalthAI: An Open-Source Computer Vision Platform for Cultural Heritage
  4. 2026Co-creation of AI technology, empowering curators of cultural heritage information and guarding research commons
  5. 2025Provenance Analysis of Archaeological Artifacts via Multimodal RAG Systems
  6. 2026VaseMuseum: Digital Intelligent Museum for Ancient Greek Pottery
  7. 2026On the Cultural Anachronism and Temporal Reasoning in Vision Language Models
  8. 2026ChinaHeritaQA: A Culturally-Grounded Visual Question Answering Dataset for World Heritage Sites in China