RADD: Retrieval-Augmented Discrete Diffusion for Multi-Modal Knowledge Graph Completion
On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG
also in 1 more
Abstract (arXiv)
Most multi-modal knowledge graph completion (MMKGC) models use one embedding scorer to conduct both retrieval over the full entity set and final link prediction. We argue that this coupling is a core bottleneck: global high-recall search and local fine-grained disambiguation require different inductive biases. Therefore, we propose a Retrieval-Augmented Discrete Diffusion (RADD) framework to decouple retrieval and reranking for MMKGC. A relation-aware multimodal knowledge graph embedding (KGE) retriever serves as both global retriever and distillation teacher, while a conditional discrete denoiser performs shortlist-level entity-identity generation for reranking. Training combines KGE supervision, denoising cross-entropy, and temperature-scaled distillation from the retriever to the denoiser. At inference, the designed Diff-Rerank first forms a top-K shortlist with the retriever and then reranks it with the denoiser, ensuring that recall is a strict requirement for precision. Experiments on three MMKGC benchmarks show that RADD achieves the best performance and consistent gains over strong unimodal, multimodal, and LLM-based baselines, while ablations further verify each component's contribution.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 17 of its 31 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
17 of 31 references.
References · 17
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,685
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 930
- 2016Complex Embeddings for Simple Link Predictioncited by 899
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 894
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
- 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
- 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
- 2019MMKG: Multi-Modal Knowledge Graphscited by 104
- 2016Image-embodied Knowledge Representation Learningcited by 68
- 2020PairRE: Knowledge Graph Embeddings via Paired Relation Vectorscited by 67
- 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 51
- 2019Orthogonal Relation Transforms with Graph Context Modeling for Knowledge Graph Embeddingcited by 38
5 more
- 2018Embedding Multimodal Relational Data for Knowledge Base Completioncited by 34
- 2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23
- 2022Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Samplingcited by 18
- 2024MKGL: Mastery of a Three-Word Languagecited by 17
- 2024Multiple Heads are Better than One: Mixture of Modality Knowledge Experts for Entity Representation Learningcited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Conditional Diffusion Guided Knowledge Transfer for Multi-Domain Knowledge Graph Completion
- 2025DiffusionCom: Structure-Aware Multimodal Diffusion Model for Multimodal Knowledge Graph Completion
- 2025Less is More: Denoising Knowledge Graphs For Retrieval Augmented Generation
- 2026MGDT: MLLM-Guided Diffusion Transformer with Relation-Adaptive Mixture-of-Experts for Multimodal Knowledge Graph Completion
- 2025Flow-Modulated Scoring for Semantic-Aware Knowledge Graph Completion
- 2024Retrieval, Reasoning, Re-ranking: A Context-Enriched Framework for Knowledge Graph Completion
- 2025DANS-KGC: Diffusion Based Adaptive Negative Sampling for Knowledge Graph Completion
- 2025Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completion