Learning Flexible Forward Trajectories for Masked Molecular Diffusion
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Masked diffusion models (MDMs) have achieved notable progress in modeling discrete data, while their potential in molecular generation remains underexplored. In this work, we explore their potential and introduce the surprising result that naively applying standards MDMs severely degrades the performance. We identify the critical cause of this issue as a state-clashing problem-where the forward diffusion of distinct molecules collapse into a common state, resulting in a mixture of reconstruction targets that cannot be learned using typical reverse diffusion process with unimodal predictions. To mitigate this, we propose Masked Element-wise Learnable Diffusion (MELD) that orchestrates per-element corruption trajectories to avoid collision between distinct molecular graphs. This is achieved through a parameterized noise scheduling network that assigns distinct corruption rates to individual graph elements, i.e., atoms and bonds. Extensive experiments on diverse molecular benchmarks reveal that MELD markedly enhances overall generation quality compared to element-agnostic noise scheduling, increasing the chemical validity of vanilla MDMs on ZINC250K from 15% to 93%, Furthermore, it achieves state-of-the-art property alignment in conditional generation tasks.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 71 of its 87 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
71 of 87 references.
Closest ancestors · 9
Same direction, newest first
- 2024TabDiff: a Mixed-type Diffusion Model for Tabular Data Generation27 Oct
- 2024DeFoG: Discrete Flow Matching for Graph Generation5 Oct
- 2024Training-Free Guidance for Discrete Diffusion Models for Molecular Generation11 Sep
- 2024Discrete-state Continuous-time Diffusion for Graph Generation19 May
- 2024Graph Diffusion Transformers for Multi-Conditional Molecular Generation24 Jan
- 2023Autoregressive Diffusion Model for Graph Generation17 Jul
- 2022DiGress: Discrete Denoising diffusion for graph generation29 Sep
- 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equations5 Feb
- 2020Permutation Invariant Graph Generation via Score-Based Generative Modeling2 Mar
Other references · 62
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
38 more
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2021Variational Diffusion Modelscited by 1,153
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
- 2024Simple and Effective Masked Diffusion Language Modelscited by 848
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 652
- 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 648
- 2023A Comprehensive Overview of Large Language Modelscited by 648
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 602
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 574
- 2022A Continuous Time Framework for Discrete Denoising Modelscited by 451
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
- 2018GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoderscited by 383
- 2018Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generationcited by 364
- 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 333
- 2020GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generationcited by 305
- 2018GuacaMol: Benchmarking Models for De Novo Molecular Designcited by 297
- 2022DiffusionBERT: Improving Generative Masked Language Models with Diffusion Modelscited by 214
- 2018Fr'echet ChemNet Distance: A metric for generative models for molecules in drug discoverycited by 194
- 2020MoFlow: An Invertible Flow Model for Generating Molecular Graphscited by 185
- 2021GraphDF: A Discrete Flow Model for Molecular Graph Generationcited by 180
- 2022Sample Efficiency Matters: A Benchmark for Practical Molecular Optimizationcited by 155
- 2023Diffusion Schr"odinger Bridge Matchingcited by 153
- 2023Graph Inductive Biases in Transformers without Message Passingcited by 153
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
- 2022SPECTRE: Spectral Conditioning Helps to Overcome the Expressivity Limits of One-shot Graph Generatorscited by 99
- 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
- 2023Diffusion Bridge Mixture Transports, Schr"odinger Bridge Problems and Generative Modelingcited by 80
- 2019Latent Normalizing Flows for Discrete Sequencescited by 67
- 2024Efficient Evolutionary Search Over Chemical Space with Large Language Modelscited by 61
- 2023Graph Generation with Diffusion Mixturecited by 55
- 2023Scalable Diffusion for Materials Generationcited by 54
- 2021Differentiable Scaffolding Tree for Molecular Optimizationcited by 53
- 2023Diffusion Models With Learned Adaptive Noisecited by 51
- 2023Sample-efficient Multi-objective Molecular Optimization with GFlowNetscited by 50
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026TUBE: Tangent Upper Bound on Evidence for Discrete Diffusion Language Modelscited by 2
- 2026VQ-SAD: Vector Quantized Structure Aware Diffusion For Molecule Generationcited by 1
- 2026From Scores to Gibbs Correctors: Accelerating Uniform-Rate Discrete Diffusion Modelscited by 1
- 2026A Systematic Evaluation of Co-folding Model Representations for Small-Molecule Learningcited by 0
- 2026MolHIT: Advancing Molecular-Graph Generation with Hierarchical Discrete Diffusion Modelscited by 0
- 2026Graph Forward Distribution Matching for Molecular Inverse Designcited by 0
- 2026MIRRA: Fast, High-Fidelity Molecular Generation with Chemistry-Informed Discrete Flow Matchingcited by 0
- 2026MIRRA: Fast, High-Fidelity Molecular Generation with Chemistry-Informed Discrete Flow Matching12 Oct 2026
- 2026Graph Forward Distribution Matching for Molecular Inverse Design25 Sep 2026
- 2026From Scores to Gibbs Correctors: Accelerating Uniform-Rate Discrete Diffusion Models26 May 2026
- 2026TUBE: Tangent Upper Bound on Evidence for Discrete Diffusion Language Models22 May 2026
- 2026VQ-SAD: Vector Quantized Structure Aware Diffusion For Molecule Generation1 May 2026
- 2026MolHIT: Advancing Molecular-Graph Generation with Hierarchical Discrete Diffusion Models19 Feb 2026
- 2026A Systematic Evaluation of Co-folding Model Representations for Small-Molecule Learning2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025DiffMS: Diffusion Generation of Molecules Conditioned on Mass Spectra
- 2026Breaking the Bottlenecks: Scalable Diffusion Models for 3D Molecular Generation
- 2026MotifRole-Diff: Risk-Optimal Role-Aware Corruption for Masked Molecular Graph Diffusion
- 2025Graph Diffusion that can Insert and Delete
- 2026Insertion Based Sequence Generation with Learnable Order Dynamics
- 2025DMol: A Highly Efficient and Chemical Motif-Preserving Molecule Generation Platform
- 2026Equivariant Asynchronous Diffusion: An Adaptive Denoising Schedule for Accelerated Molecular Conformation Generation
- 2022DiffMD: A Geometric Diffusion Model for Molecular Dynamics Simulations