MACO: A Modality Adversarial and Contrastive Framework for Modality-missing Multi-modal Knowledge Graph Completion
Not on the map. Why?
Abstract (arXiv)
Recent years have seen significant advancements in multi-modal knowledge graph completion (MMKGC). MMKGC enhances knowledge graph completion (KGC) by integrating multi-modal entity information, thereby facilitating the discovery of unobserved triples in the large-scale knowledge graphs (KGs). Nevertheless, existing methods emphasize the design of elegant KGC models to facilitate modality interaction, neglecting the real-life problem of missing modalities in KGs. The missing modality information impedes modal interaction, consequently undermining the model's performance. In this paper, we propose a modality adversarial and contrastive framework (MACO) to solve the modality-missing problem in MMKGC. MACO trains a generator and discriminator adversarially to generate missing modality features that can be incorporated into the MMKGC model. Meanwhile, we design a cross-modal contrastive loss to improve the performance of the generator. Experiments on public benchmarks with further explorations demonstrate that MACO could achieve state-of-the-art results and serve as a versatile framework to bolster various MMKGC models. Our code and benchmark data are available at https://github.com/zjukg/MACO.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 13 Aug 2023.
Builds on
14 of 26 references.
References · 14
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2015Empirical Evaluation of Rectified Activations in Convolutional Networkcited by 519
- 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
- 2017Knowledge Graph Completion via Complex Tensor Factorizationcited by 80
- 2016Image-embodied Knowledge Representation Learningcited by 68
- 2020InfoMax-GAN: Improved Adversarial Image Generation via Information Maximization and Contrastive Learningcited by 37
- 2022MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybridcited by 30
- 2018Semi-supervised Deep Generative Modelling of Incomplete Multi-Modality Emotional Datacited by 29
Built on by
Citing papers per year: 2025: 1.
1 paper.