Time Travel: A Comprehensive Benchmark to Evaluate LMMs on Historical and Cultural Artifacts
Not on the map. Why?
Abstract (arXiv)
Understanding historical and cultural artifacts demands human expertise and advanced computational techniques, yet the process remains complex and time-intensive. While large multimodal models offer promising support, their evaluation and improvement require a standardized benchmark. To address this, we introduce TimeTravel, a benchmark of 10,250 expert-verified samples spanning 266 distinct cultures across 10 major historical regions. Designed for AI-driven analysis of manuscripts, artworks, inscriptions, and archaeological discoveries, TimeTravel provides a structured dataset and robust evaluation framework to assess AI models' capabilities in classification, interpretation, and historical comprehension. By integrating AI with historical research, TimeTravel fosters AI-powered tools for historians, archaeologists, researchers, and cultural tourists to extract valuable insights while ensuring technology contributes meaningfully to historical discovery and cultural heritage preservation. We evaluate contemporary AI models on TimeTravel, highlighting their strengths and identifying areas for improvement. Our goal is to establish AI as a reliable partner in preserving cultural heritage, ensuring that technological advancements contribute meaningfully to historical discovery. Our code is available at: urlhttps://github.com/mbzuai-oryx/TimeTravel.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 15 of its 29 references that are in the map. First posted on arXiv 20 Feb 2025.
Builds on
15 of 29 references.
References · 15
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
- 2024Investigating Cultural Alignment of Large Language Modelscited by 140
- 2024CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmarkcited by 118
- 2024Benchmarking Vision Language Models for Cultural Understandingcited by 100
- 2024All Languages Matter: Evaluating LMMs on Culturally Diverse 100 Languagescited by 55
- 2025CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countriescited by 40
- 2024Peacock: A Family of Arabic Multimodal Large Language Models and Benchmarkscited by 32
- 2020KaoKore: A Pre-modern Japanese Art Facial Expression Datasetcited by 18
3 more
Built on by
Citing papers per year: 2025: 5; 2026: 5.
10 papers.
- 2025MAKIEval: A Multilingual Automatic WiKidata-based Framework for Cultural Awareness Evaluation for LLMscited by 13
- 2025Mitigating Long-tail Distribution in Oracle Bone Inscriptions: Dataset, Model, and Benchmarkcited by 5
- 2025ARB: A Comprehensive Arabic Multimodal Reasoning Benchmarkcited by 4
- 2025Domain Specific Benchmarks for Evaluating Multimodal Large Language Modelscited by 2
- 2025LLM-Driven Completeness and Consistency Evaluation for Cultural Heritage Data Augmentation in Cross-Modal Retrievalcited by 1
- 2026CHisAgent: A Multi-Agent Framework for Event Taxonomy Construction in Ancient Chinese Cultural Systemscited by 1
- 2026On the Cultural Anachronism and Temporal Reasoning in Vision Language Modelscited by 0
- 2026Reasoning4Sciences: Bridging Reasoning Language Models to All Scientific Branchescited by 0
- 2026ArtiFact: A Large-Scale Multi-Modal Cultural Heritage Datasetcited by 0
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systemscited by 0
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systems18 Sep 2026
- 2026ArtiFact: A Large-Scale Multi-Modal Cultural Heritage Dataset8 Jun 2026
- 2026Reasoning4Sciences: Bridging Reasoning Language Models to All Scientific Branches31 May 2026
- 2026On the Cultural Anachronism and Temporal Reasoning in Vision Language Models14 May 2026
- 2026CHisAgent: A Multi-Agent Framework for Event Taxonomy Construction in Ancient Chinese Cultural Systems9 Jan 2026
- 2025LLM-Driven Completeness and Consistency Evaluation for Cultural Heritage Data Augmentation in Cross-Modal Retrieval9 Nov 2025
- 2025Domain Specific Benchmarks for Evaluating Multimodal Large Language Models15 Jun 2025
- 2025MAKIEval: A Multilingual Automatic WiKidata-based Framework for Cultural Awareness Evaluation for LLMs27 May 2025
- 2025ARB: A Comprehensive Arabic Multimodal Reasoning Benchmark22 May 2025
- 2025Mitigating Long-tail Distribution in Oracle Bone Inscriptions: Dataset, Model, and Benchmark13 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2025On Path to Multimodal Historical Reasoning: HistBench and HistAgent
- 2026Uncertainty-Aware Art-Historical Dating with Vision-Language Models
- 2026AmalthAI: An Open-Source Computer Vision Platform for Cultural Heritage
- 2026TimeLens: On-Device Artifact Recognition with Retrieval-Augmented Question Answering for the Grand Egyptian Museum
- 2026Artificial Intelligence-Assisted Digital Inventory of Cultural Heritage & Traditional Knowledge: Case for Indonesian Open Digital Library of Culture
- 2025Provenance Analysis of Archaeological Artifacts via Multimodal RAG Systems
- 2025Synthetic History: Evaluating Visual Representations of the Past in Diffusion Models
- 2024Cultural Heritage 3D Reconstruction with Diffusion Networks