# One Pass for All: A Discrete Diffusion Model for Knowledge Graph Triple Set Prediction

arXiv: https://arxiv.org/abs/2604.18344 · HTML: https://mlsanity.com/paper/2604.18344/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Placed in Discrete and text diffusion, one of 14 directions in Diffusion models.
- Builds on 32 of its 43 references that are in the map.
- First posted on arXiv 20 Apr 2026.

## Placed in

- Diffusion models / [Discrete and text diffusion](https://mlsanity.com/diffusion/discrete-and-text-diffusion/)

## Builds on (most cited first, 30 of 32)

- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [High-Resolution Image Synthesis with Latent Diffusion Models](https://mlsanity.com/paper/2112.10752/) (2021)
- [Scalable Diffusion Models with Transformers](https://mlsanity.com/paper/2212.09748/) (2022)
- [Structured Denoising Diffusion Models in Discrete State-Spaces](https://mlsanity.com/paper/2107.03006/) (2021)
- [Modeling Relational Data with Graph Convolutional Networks](https://mlsanity.com/paper/1703.06103/) (2017)
- [RePaint: Inpainting using Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2201.09865/) (2022)
- [Large Language Diffusion Models](https://mlsanity.com/paper/2502.09992/) (2025)
- [RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space](https://mlsanity.com/paper/1902.10197/) (2019)
- [Convolutional 2D Knowledge Graph Embeddings](https://mlsanity.com/paper/1707.01476/) (2017)
- [Unifying Large Language Models and Knowledge Graphs: A Roadmap](https://mlsanity.com/paper/2306.08302/) (2023)
- [A Survey on Knowledge Graphs: Representation, Acquisition and Applications](https://mlsanity.com/paper/2002.00388/) (2020)
- [DiGress: Discrete Denoising diffusion for graph generation](https://mlsanity.com/paper/2209.14734/) (2022)
- [Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models](https://mlsanity.com/paper/2503.09573/) (2025)
- [Composition-based Multi-Relational Graph Convolutional Networks](https://mlsanity.com/paper/1911.03082/) (2019)
- [QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering](https://mlsanity.com/paper/2104.06378/) (2021)
- [Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equations](https://mlsanity.com/paper/2202.02514/) (2022)
- [Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction](https://mlsanity.com/paper/1911.09419/) (2019)
- [Towards Foundation Models for Knowledge Graph Reasoning](https://mlsanity.com/paper/2310.04562/) (2023)
- [Sequence-to-Sequence Knowledge Graph Completion and Question Answering](https://mlsanity.com/paper/2203.10321/) (2022)
- [PairRE: Knowledge Graph Embeddings via Paired Relation Vectors](https://mlsanity.com/paper/2011.03798/) (2020)
- [A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphs](https://mlsanity.com/paper/2206.04798/) (2022)
- [Graph Diffusion Transformers for Multi-Conditional Molecular Generation](https://mlsanity.com/paper/2401.13858/) (2024)
- [AliCG: Fine-grained and Evolvable Conceptual Graph Construction for Semantic Search at Alibaba](https://mlsanity.com/paper/2106.01686/) (2021)
- [Meta-Knowledge Transfer for Inductive Knowledge Graph Embedding](https://mlsanity.com/paper/2110.14170/) (2021)
- [Path-based Explanation for Knowledge Graph Completion](https://mlsanity.com/paper/2401.02290/) (2024)
- [Stochastic Conditional Diffusion Models for Robust Semantic Image Synthesis](https://mlsanity.com/paper/2402.16506/) (2024)
- [Unifying Deductive and Abductive Reasoning in Knowledge Graphs with Masked Diffusion Model](https://mlsanity.com/paper/2510.11462/) (2025)
- [Start from Zero: Triple Set Prediction for Automatic Knowledge Graph Completion](https://mlsanity.com/paper/2406.18166/) (2024)
- [Query2GMM: Learning Representation with Gaussian Mixture Model for Reasoning over Knowledge Graphs](https://mlsanity.com/paper/2306.10367/) (2023)
- [DPCL-Diff: The Temporal Knowledge Graph Reasoning Based on Graph Node Diffusion Model with Dual-Domain Periodic Contrastive Learning](https://mlsanity.com/paper/2411.01477/) (2024)

## Abstract (arXiv)

Triple set prediction (TSP) aims to discover missing facts from an incomplete knowledge graph without predefined queries. Existing approaches typically construct the predicted set through triple-level scoring, sometimes preceded by entity pair filtering that can exclude valid missing facts. We propose DiffTSP, a conditional discrete diffusion model that formulates missing fact discovery as conditional subgraph generation. In each subgraph, DiffTSP directly predicts the missing relational structure without a separate entity pair selection stage. The model learns to generate masked target relation states at different corruption levels, with the observed support subgraph retained as conditioning context. Our structure-aware denoising network integrates a Relational Context Encoder, which captures local relational patterns through relation-guided message passing, and a Relational Graph Diffusion Transformer, which models broader structural interactions through relational attention. During generation, partially generated relations can also serve as provisional context for subsequent predictions. Experiments on three public datasets demonstrate improved TSP performance over strong baselines. Additional analyses show lower conflict rates in the predicted triple sets relative to the evaluated baselines. Code: https://anonymous.4open.science/r/DiffTSP-0F92/.
