GCCM: Enhancing Generative Graph Prediction via Contrastive Consistency Model
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Conditional generative models, particularly diffusion-based methods, have recently been applied to graph prediction by modeling the target as a conditional distribution given the input graph, yielding competitive results compared to deterministic predictor. However, existing diffusion-based prediction methods typically require expensive iterative denoising at inference and often suffer from unstable sampling, which motivates recent efforts to reduce inference denoising steps and enable stable sampling via techniques such as consistency training. Despite this progress, we find that existing consistency training methods for graph prediction could potentially fall into a shortcut solution: the model may attempt to satisfy the self-consistency constraint by ignoring the noisy target (i.e., assigning it negligible weight), ultimately collapsing into a purely deterministic predictor. To mitigate such shortcut solution, we propose GCCM, a graph contrastive consistency model that goes beyond isolated pairwise matching between the same target at different noise levels by introducing negative pairs into a contrastive consistency objective. This adds an additional separation requirement, making the shortcut solution no longer trivially sufficient to satisfy the proposed objective. Moreover, we apply feature perturbation to the input node/edge features to break identical conditioning on the input graph, so that the shortcut no longer yields the same predictions across noise levels and becomes less attractive. Extensive experiments on benchmark datasets demonstrate that GCCM mitigates the shortcut solution and yields consistent performance improvements in graph prediction compared to deterministic predictors.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 28 of its 31 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
28 of 31 references.
Closest ancestors · 3
Same direction, newest first
- 2025DiffGED: Computing Graph Edit Distance via Diffusion-based Graph Matching24 Mar
- 2024Unifying Generation and Prediction on Graphs with Latent Graph Diffusion4 Feb
- 2022DiGress: Discrete Denoising diffusion for graph generation29 Sep
Other references · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2017Graph Attention Networkscited by 8,923
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2023Consistency Modelscited by 1,822
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 574
13 more
- 2020Principal Neighbourhood Aggregation for Graph Netscited by 478
- 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
- 2023Improved Techniques for Training Consistency Modelscited by 439
- 2017Residual Gated Graph ConvNetscited by 346
- 2021Do Transformers Really Perform Bad for Graph Representation?cited by 320
- 2022Long Range Graph Benchmarkcited by 263
- 2021From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awarenesscited by 155
- 2023Graph Inductive Biases in Transformers without Message Passingcited by 153
- 2020Directional Graph Networkscited by 133
- 2021Global Self-Attention as a Replacement for Graph Convolutioncited by 114
- 2021Walking Out of the Weisfeiler Leman Hierarchy: Graph Learning Beyond Message Passingcited by 47
- 2025Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimizationcited by 45
- 2025Towards Unsupervised Training of Matching-based Graph Edit Distance Solver via Preference-aware GANcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024IFH: a Diffusion Framework for Flexible Design of Graph Generative Models
- 2026Efficient Graph Generation via Direct Prediction and Flow Matching
- 2025Simple and Critical Iterative Denoising: A Recasting of Discrete Diffusion in Graph Generation
- 2023Leveraging Graph Diffusion Models for Network Refinement Tasks
- 2025Graffe: Graph Representation Learning via Diffusion Probabilistic Models
- 2025Diffusion-Free Graph Generation with Next-Scale Prediction
- 2026When Edge Independence Fails: Joint Graph Diffusion with Latent Sociability Priors
- 2021Scalable Consistency Training for Graph Neural Networks via Self-Ensemble Self-Distillation