Time Imprint: Learning Time-Aware Representations in Multi-Modal Knowledge Graphs
Not on the map. Why?
Abstract (arXiv)
Multi-Modal Knowledge Graphs (MMKGs) enrich entities with multiple modalities such as text and images, yet entities with highly similar multi-modal features remain difficult to distinguish. Temporal information of an entity can serve as an additional modality to disambiguate such entities, but existing approaches rarely treat time as a separate modality alongside text and images due to two major challenges: (1) sparse temporal semantics, which hinder alignment with richer modalities, and (2) multiple timestamps, which introduce noise or reduce robustness in representation learning. To address these challenges, we propose Time Imprint, a framework that treats time as an entity-level modality and jointly aligns temporal, textual, and visual representations via a three-view contrastive objective. Additionally, to mitigate multi-timestamp ambiguity, Time Imprint studies a compact timestamp subset selection design space and aggregates the selected timestamps into a discriminative temporal embedding with attention pooling, balancing temporal specificity and robustness. Experiments on three MMKG benchmarks demonstrate that Time Imprint achieves state-of-the-art link prediction performance, improving Hits@1 by up to 6.07% overall and yielding up to 58% gains on the subset of the top-1% ambiguity samples. We further examine different fusion strategies and the sensitivity to timestamp availability and quality, clarifying when and why time-as-modality is most beneficial, while adding only modest training overhead. We release our code at https://anonymous.4open.science/r/Time-Imprint.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
25 of 44 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2016Complex Embeddings for Simple Link Predictioncited by 902
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2022BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizerscited by 303
- 2021Temporal Knowledge Graph Reasoning Based on Evolutional Representation Learningcited by 106
- 2019MMKG: Multi-Modal Knowledge Graphscited by 105
- 2019Diachronic Embedding for Temporal Knowledge Graph Completioncited by 104
- 2020Learning from History: Modeling Temporal Knowledge Graphs with Sequential Copy-Generation Networkscited by 84
- 2022Multi-Modal Knowledge Graph Construction and Application: A Surveycited by 74
- 2016Image-embodied Knowledge Representation Learningcited by 68
- 2020Inductive Entity Representations from Text via Link Predictioncited by 62
13 more
- 2020Visual Pivoting for (Unsupervised) Entity Alignmentcited by 47
- 2024A Survey on Temporal Knowledge Graph: Representation Learning and Applicationscited by 30
- 2023IMF: Interactive Multimodal Fusion Model for Link Predictioncited by 28
- 2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23
- 2021Multi-modal Entity Alignment in Hyperbolic Spacecited by 19
- 2022Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Samplingcited by 18
- 2024Tokenization, Fusion, and Augmentation: Towards Fine-grained Multi-modal Entity Representationcited by 14
- 2024Multiple Heads are Better than One: Mixture of Modality Knowledge Experts for Entity Representation Learningcited by 13
- 2024Noise-powered Multi-modal Knowledge Graph Representation Frameworkcited by 7
- 2024Progressively Modality Freezing for Multi-Modal Entity Alignmentcited by 5
- 2023End-to-End Learning on Multimodal Knowledge Graphscited by 3
- 2024Multi-modal Semantic Understanding with Contrastive Cross-modal Feature Alignmentcited by 3
- 2025Transformer-Based Multimodal Knowledge Graph Completion with Link-Aware Contextscited by 1
Built on by
Not cited yet.