mlsanityData to 7 Oct 2026

Time Travel: A Comprehensive Benchmark to Evaluate LMMs on Historical and Cultural Artifacts

arXiv 2502.14865 ↗First posted 20 Feb 2025cs.CV cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

Understanding historical and cultural artifacts demands human expertise and advanced computational techniques, yet the process remains complex and time-intensive. While large multimodal models offer promising support, their evaluation and improvement require a standardized benchmark. To address this, we introduce TimeTravel, a benchmark of 10,250 expert-verified samples spanning 266 distinct cultures across 10 major historical regions. Designed for AI-driven analysis of manuscripts, artworks, inscriptions, and archaeological discoveries, TimeTravel provides a structured dataset and robust evaluation framework to assess AI models' capabilities in classification, interpretation, and historical comprehension. By integrating AI with historical research, TimeTravel fosters AI-powered tools for historians, archaeologists, researchers, and cultural tourists to extract valuable insights while ensuring technology contributes meaningfully to historical discovery and cultural heritage preservation. We evaluate contemporary AI models on TimeTravel, highlighting their strengths and identifying areas for improvement. Our goal is to establish AI as a reliable partner in preserving cultural heritage, ensuring that technological advancements contribute meaningfully to historical discovery. Our code is available at: urlhttps://github.com/mbzuai-oryx/TimeTravel.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 15 of its 29 references that are in the map. First posted on arXiv 20 Feb 2025.

Builds on

15 of 29 references.

References · 15

  1. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  2. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  3. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  4. 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
  5. 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
  6. 2024Investigating Cultural Alignment of Large Language Modelscited by 140
  7. 2024CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmarkcited by 118
  8. 2024Benchmarking Vision Language Models for Cultural Understandingcited by 100
  9. 2024All Languages Matter: Evaluating LMMs on Culturally Diverse 100 Languagescited by 55
  10. 2025CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countriescited by 40
  11. 2024Peacock: A Family of Arabic Multimodal Large Language Models and Benchmarkscited by 32
  12. 2020KaoKore: A Pre-modern Japanese Art Facial Expression Datasetcited by 18
3 more
  1. 2024CAMEL-Bench: A Comprehensive Arabic LMM Benchmarkcited by 17
  2. 2025An Investigation into Value Misalignment in LLM-Generated Texts for Cultural Heritagecited by 8
  3. 2025AIN: The Arabic INclusive Large Multimodal Modelcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 5.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025On Path to Multimodal Historical Reasoning: HistBench and HistAgent
  2. 2026Uncertainty-Aware Art-Historical Dating with Vision-Language Models
  3. 2026AmalthAI: An Open-Source Computer Vision Platform for Cultural Heritage
  4. 2026TimeLens: On-Device Artifact Recognition with Retrieval-Augmented Question Answering for the Grand Egyptian Museum
  5. 2026Artificial Intelligence-Assisted Digital Inventory of Cultural Heritage & Traditional Knowledge: Case for Indonesian Open Digital Library of Culture
  6. 2025Provenance Analysis of Archaeological Artifacts via Multimodal RAG Systems
  7. 2025Synthetic History: Evaluating Visual Representations of the Past in Diffusion Models
  8. 2024Cultural Heritage 3D Reconstruction with Diffusion Networks