mlsanityData to 14 Oct 2026

Time Imprint: Learning Time-Aware Representations in Multi-Modal Knowledge Graphs

arXiv 2607.09777 ↗First posted 8 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-Modal Knowledge Graphs (MMKGs) enrich entities with multiple modalities such as text and images, yet entities with highly similar multi-modal features remain difficult to distinguish. Temporal information of an entity can serve as an additional modality to disambiguate such entities, but existing approaches rarely treat time as a separate modality alongside text and images due to two major challenges: (1) sparse temporal semantics, which hinder alignment with richer modalities, and (2) multiple timestamps, which introduce noise or reduce robustness in representation learning. To address these challenges, we propose Time Imprint, a framework that treats time as an entity-level modality and jointly aligns temporal, textual, and visual representations via a three-view contrastive objective. Additionally, to mitigate multi-timestamp ambiguity, Time Imprint studies a compact timestamp subset selection design space and aggregates the selected timestamps into a discriminative temporal embedding with attention pooling, balancing temporal specificity and robustness. Experiments on three MMKG benchmarks demonstrate that Time Imprint achieves state-of-the-art link prediction performance, improving Hits@1 by up to 6.07% overall and yielding up to 58% gains on the subset of the top-1% ambiguity samples. We further examine different fusion strategies and the sensitivity to timestamp availability and quality, clarifying when and why time-as-modality is most beneficial, while adding only modest training overhead. We release our code at https://anonymous.4open.science/r/Time-Imprint.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 8 Jul 2026.

Builds on

25 of 44 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
  3. 2016Complex Embeddings for Simple Link Predictioncited by 902
  4. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
  5. 2022BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizerscited by 303
  6. 2021Temporal Knowledge Graph Reasoning Based on Evolutional Representation Learningcited by 106
  7. 2019MMKG: Multi-Modal Knowledge Graphscited by 105
  8. 2019Diachronic Embedding for Temporal Knowledge Graph Completioncited by 104
  9. 2020Learning from History: Modeling Temporal Knowledge Graphs with Sequential Copy-Generation Networkscited by 84
  10. 2022Multi-Modal Knowledge Graph Construction and Application: A Surveycited by 74
  11. 2016Image-embodied Knowledge Representation Learningcited by 68
  12. 2020Inductive Entity Representations from Text via Link Predictioncited by 62
13 more
  1. 2020Visual Pivoting for (Unsupervised) Entity Alignmentcited by 47
  2. 2024A Survey on Temporal Knowledge Graph: Representation Learning and Applicationscited by 30
  3. 2023IMF: Interactive Multimodal Fusion Model for Link Predictioncited by 28
  4. 2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23
  5. 2021Multi-modal Entity Alignment in Hyperbolic Spacecited by 19
  6. 2022Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Samplingcited by 18
  7. 2024Tokenization, Fusion, and Augmentation: Towards Fine-grained Multi-modal Entity Representationcited by 14
  8. 2024Multiple Heads are Better than One: Mixture of Modality Knowledge Experts for Entity Representation Learningcited by 13
  9. 2024Noise-powered Multi-modal Knowledge Graph Representation Frameworkcited by 7
  10. 2024Progressively Modality Freezing for Multi-Modal Entity Alignmentcited by 5
  11. 2023End-to-End Learning on Multimodal Knowledge Graphscited by 3
  12. 2024Multi-modal Semantic Understanding with Contrastive Cross-modal Feature Alignmentcited by 3
  13. 2025Transformer-Based Multimodal Knowledge Graph Completion with Link-Aware Contextscited by 1

Built on by

Not cited yet.