mlsanityData to 13 Oct 2026

RADD: Retrieval-Augmented Discrete Diffusion for Multi-Modal Knowledge Graph Completion

arXiv 2604.25693 ↗First posted 28 Apr 2026cs.AIcited by 0

On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG

also in 1 more
Abstract (arXiv)

Most multi-modal knowledge graph completion (MMKGC) models use one embedding scorer to conduct both retrieval over the full entity set and final link prediction. We argue that this coupling is a core bottleneck: global high-recall search and local fine-grained disambiguation require different inductive biases. Therefore, we propose a Retrieval-Augmented Discrete Diffusion (RADD) framework to decouple retrieval and reranking for MMKGC. A relation-aware multimodal knowledge graph embedding (KGE) retriever serves as both global retriever and distillation teacher, while a conditional discrete denoiser performs shortlist-level entity-identity generation for reranking. Training combines KGE supervision, denoising cross-entropy, and temperature-scaled distillation from the retriever to the denoiser. At inference, the designed Diff-Rerank first forms a top-K shortlist with the retriever and then reranks it with the denoiser, ensuring that recall is a strict requirement for precision. Experiments on three MMKGC benchmarks show that RADD achieves the best performance and consistent gains over strong unimodal, multimodal, and LLM-based baselines, while ablations further verify each component's contribution.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 17 of its 31 references that are in the map. First posted on arXiv 28 Apr 2026.

Builds on

17 of 31 references.

References · 17

  1. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,685
  2. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 930
  3. 2016Complex Embeddings for Simple Link Predictioncited by 899
  4. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 894
  5. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
  6. 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
  7. 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
  8. 2019MMKG: Multi-Modal Knowledge Graphscited by 104
  9. 2016Image-embodied Knowledge Representation Learningcited by 68
  10. 2020PairRE: Knowledge Graph Embeddings via Paired Relation Vectorscited by 67
  11. 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 51
  12. 2019Orthogonal Relation Transforms with Graph Context Modeling for Knowledge Graph Embeddingcited by 38
5 more
  1. 2018Embedding Multimodal Relational Data for Knowledge Base Completioncited by 34
  2. 2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23
  3. 2022Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Samplingcited by 18
  4. 2024MKGL: Mastery of a Three-Word Languagecited by 17
  5. 2024Multiple Heads are Better than One: Mixture of Modality Knowledge Experts for Entity Representation Learningcited by 13

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Conditional Diffusion Guided Knowledge Transfer for Multi-Domain Knowledge Graph Completion
  2. 2025DiffusionCom: Structure-Aware Multimodal Diffusion Model for Multimodal Knowledge Graph Completion
  3. 2025Less is More: Denoising Knowledge Graphs For Retrieval Augmented Generation
  4. 2026MGDT: MLLM-Guided Diffusion Transformer with Relation-Adaptive Mixture-of-Experts for Multimodal Knowledge Graph Completion
  5. 2025Flow-Modulated Scoring for Semantic-Aware Knowledge Graph Completion
  6. 2024Retrieval, Reasoning, Re-ranking: A Context-Enriched Framework for Knowledge Graph Completion
  7. 2025DANS-KGC: Diffusion Based Adaptive Negative Sampling for Knowledge Graph Completion
  8. 2025Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completion