mlsanityData to 7 Oct 2026

From Tokens to Blocks: A Block-Diffusion Perspective on Molecular Generation

arXiv 2601.21964 ↗First posted 29 Jan 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Drug discovery can be viewed as a combinatorial search over an immense chemical space, motivating the development of deep generative models for de novo molecular design. Among these, GPT-based molecular language models (MLM) have shown strong molecular design performance by learning chemical syntax and semantics from large-scale data. However, existing MLMs face two fundamental limitations: they inadequately capture the graph-structured nature of molecules when formulated as next-token prediction problems, and they typically lack explicit mechanisms for target-aware generation. Here, we propose SoftMol, a unified framework that co-designs molecular representation, model architecture, and search strategy for target-aware molecular generation. SoftMol introduces soft fragments, a rule-free block representation of SMILES that enables diffusion-native modeling, and develops SoftBD, the first block-diffusion molecular language model that combines local bidirectional diffusion with autoregressive generation under molecular structural constraints. To favor generated molecules with high drug-likeness and synthetic accessibility, SoftBD is trained on a carefully curated dataset named ZINC-Curated. SoftMol further integrates a gated Monte Carlo tree search to assemble fragments in a target-aware manner. Experimental results show that, compared with current state-of-the-art models, SoftMol achieves 100% chemical validity, improves binding affinity by 9.7%, yields a 2-3x increase in molecular diversity, and delivers a 6.6x speedup in inference efficiency. Code is available at https://github.com/szu-aicourse/softmol

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 65 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

37 of 65 references.

References · 37

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  4. 2024Simple and Effective Masked Diffusion Language Modelscited by 800
  5. 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
  6. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 503
  7. 2018MolGAN: An implicit generative model for small molecular graphscited by 392
  8. 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 385
  9. 2017Grammar Variational Autoencodercited by 283
  10. 2018Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Modelscited by 270
  11. 2017Molecular De Novo Design through Deep Reinforcement Learningcited by 264
  12. 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
25 more
  1. 2020Hierarchical Generation of Molecular Graphs using Structural Motifscited by 204
  2. 2024Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Samplingcited by 204
  3. 2018Optimization of Molecules via Deep Reinforcement Learningcited by 199
  4. 2022SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Controlcited by 191
  5. 2022Pocket2Mol: Efficient Molecular Sampling Based on 3D Protein Pocketscited by 182
  6. 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
  7. 2024Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizingcited by 123
  8. 2021Geometric Deep Learning on Molecular Representationscited by 113
  9. 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
  10. 2021Hit and Lead Discovery with Explorative RL and Fragment-based Molecule Generationcited by 68
  11. 2021Keeping it Simple: Language Models can learn Complex Molecular Distributionscited by 68
  12. 2019Augmenting Genetic Algorithms with Deep Neural Networks for Exploring the Chemical Spacecited by 66
  13. 2021Molecule Generation by Principal Subgraph Mining and Assemblingcited by 53
  14. 2020Guiding Deep Molecular Optimization with Genetic Explorationcited by 51
  15. 2025GenMol: A Drug Discovery Generalist with Discrete Diffusioncited by 47
  16. 2023Gotta be SAFE: A New Framework for Molecular Designcited by 45
  17. 2022Retrieval-based Controllable Molecule Generationcited by 44
  18. 2024Genetic-guided GFlowNets for Sample Efficient Molecular Optimizationcited by 36
  19. 2017ChemTS: An Efficient Python Library for de novo Molecular Generationcited by 32
  20. 2022Group SELFIES: A Robust Fragment-Based Molecular String Representationcited by 32
  21. 2021How Much Space Has Been Explored? Measuring the Chemical Space Covered by Databases and Machine-Generated Moleculescited by 27
  22. 2024Molecule Generation with Fragment Retrieval Augmentationcited by 22
  23. 2023Drug Discovery with Dynamic Goal-aware Fragmentscited by 19
  24. 2023t-SMILES: A Scalable Fragment-based Molecular Representation Framework for De Novo Molecule Generationcited by 13
  25. 2025Toward Closed-loop Molecular Discovery via Language Model, Property Alignment and Strategic Searchcited by 3

Built on by

Not cited yet.