More Perspectives, Stronger Signals: Multi-Perspective Enhancement and Progressive Fusion for Multimodal Entity Representation Learning
Not on the map. Why?
Abstract (arXiv)
Learning effective multimodal entity representations is fundamental for reasoning tasks such as multimodal knowledge graph completion (MMKGC). However, existing methods often suffer from semantic over-smoothing within modalities and ineffective noise filtration across modalities, particularly under sparse or ambiguous conditions. To overcome these limitations, we propose PrismF, a unified framework that synergizes multi-perspective enhancement with progressive fusion to extract stronger signals from diverse inputs. PrismF enhances fine-grained intra-modal semantics through a multi-perspective mechanism that decomposes each modality into complementary views and constrains them with a decoupling loss to reduce representation collapse. Furthermore, it improves cross-modal integration through a progressive fusion strategy that dynamically calibrates inter-modal interactions, enabling the model to emphasize informative signals while suppressing noisy or unreliable ones. Extensive experiments on three public benchmarks show that PrismF achieves the strongest overall performance, including relative improvements of 4.04% in MRR and 11.17% in Hits@1 on KVC16K. Our code can be found at https://github.com/HubuKG/PrismF.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 44 references that are in the map. First posted on arXiv 29 Aug 2026.
Builds on
21 of 44 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2016Complex Embeddings for Simple Link Predictioncited by 902
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
- 2019MMKG: Multi-Modal Knowledge Graphscited by 105
- 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 53
- 2022Knowledge Graph Contrastive Learning Based on Relation-Symmetrical Structurecited by 43
9 more
- 2022Knowledge Graph Embedding: A Survey from the Perspective of Representation Spacescited by 41
- 2018Embedding Multimodal Relational Data for Knowledge Base Completioncited by 34
- 2023IMF: Interactive Multimodal Fusion Model for Link Predictioncited by 28
- 2025A Closer Look at Multimodal Representation Collapsecited by 28
- 2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23
- 2022Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Samplingcited by 18
- 2021How Does Knowledge Graph Embedding Extrapolate to Unseen Data: A Semantic Evidence Viewcited by 17
- 2024Tokenization, Fusion, and Augmentation: Towards Fine-grained Multi-modal Entity Representationcited by 14
- 2024Noise-powered Multi-modal Knowledge Graph Representation Frameworkcited by 7
Built on by
Not cited yet.