From Tokens to Blocks: A Block-Diffusion Perspective on Molecular Generation
Not on the map. Why?
Abstract (arXiv)
Drug discovery can be viewed as a combinatorial search over an immense chemical space, motivating the development of deep generative models for de novo molecular design. Among these, GPT-based molecular language models (MLM) have shown strong molecular design performance by learning chemical syntax and semantics from large-scale data. However, existing MLMs face two fundamental limitations: they inadequately capture the graph-structured nature of molecules when formulated as next-token prediction problems, and they typically lack explicit mechanisms for target-aware generation. Here, we propose SoftMol, a unified framework that co-designs molecular representation, model architecture, and search strategy for target-aware molecular generation. SoftMol introduces soft fragments, a rule-free block representation of SMILES that enables diffusion-native modeling, and develops SoftBD, the first block-diffusion molecular language model that combines local bidirectional diffusion with autoregressive generation under molecular structural constraints. To favor generated molecules with high drug-likeness and synthetic accessibility, SoftBD is trained on a carefully curated dataset named ZINC-Curated. SoftMol further integrates a gated Monte Carlo tree search to assemble fragments in a target-aware manner. Experimental results show that, compared with current state-of-the-art models, SoftMol achieves 100% chemical validity, improves binding affinity by 9.7%, yields a 2-3x increase in molecular diversity, and delivers a 6.6x speedup in inference efficiency. Code is available at https://github.com/szu-aicourse/softmol
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 65 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
37 of 65 references.
References · 37
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2023GPT-4 Technical Reportcited by 18,132
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2024Simple and Effective Masked Diffusion Language Modelscited by 800
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
- 2022DiGress: Discrete Denoising diffusion for graph generationcited by 503
- 2018MolGAN: An implicit generative model for small molecular graphscited by 392
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 385
- 2017Grammar Variational Autoencodercited by 283
- 2018Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Modelscited by 270
- 2017Molecular De Novo Design through Deep Reinforcement Learningcited by 264
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
25 more
- 2020Hierarchical Generation of Molecular Graphs using Structural Motifscited by 204
- 2024Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Samplingcited by 204
- 2018Optimization of Molecules via Deep Reinforcement Learningcited by 199
- 2022SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Controlcited by 191
- 2022Pocket2Mol: Efficient Molecular Sampling Based on 3D Protein Pocketscited by 182
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
- 2024Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizingcited by 123
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
- 2021Hit and Lead Discovery with Explorative RL and Fragment-based Molecule Generationcited by 68
- 2021Keeping it Simple: Language Models can learn Complex Molecular Distributionscited by 68
- 2019Augmenting Genetic Algorithms with Deep Neural Networks for Exploring the Chemical Spacecited by 66
- 2021Molecule Generation by Principal Subgraph Mining and Assemblingcited by 53
- 2020Guiding Deep Molecular Optimization with Genetic Explorationcited by 51
- 2025GenMol: A Drug Discovery Generalist with Discrete Diffusioncited by 47
- 2023Gotta be SAFE: A New Framework for Molecular Designcited by 45
- 2022Retrieval-based Controllable Molecule Generationcited by 44
- 2024Genetic-guided GFlowNets for Sample Efficient Molecular Optimizationcited by 36
- 2017ChemTS: An Efficient Python Library for de novo Molecular Generationcited by 32
- 2022Group SELFIES: A Robust Fragment-Based Molecular String Representationcited by 32
- 2021How Much Space Has Been Explored? Measuring the Chemical Space Covered by Databases and Machine-Generated Moleculescited by 27
- 2024Molecule Generation with Fragment Retrieval Augmentationcited by 22
- 2023Drug Discovery with Dynamic Goal-aware Fragmentscited by 19
- 2023t-SMILES: A Scalable Fragment-based Molecular Representation Framework for De Novo Molecule Generationcited by 13
- 2025Toward Closed-loop Molecular Discovery via Language Model, Property Alignment and Strategic Searchcited by 3
Built on by
Not cited yet.