mlsanityData to 14 Oct 2026

Text-guided multi-property molecular optimization with a diffusion language model

arXiv 2410.13597 ↗First posted 17 Oct 2024cs.LG cs.AIcited by 11

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Molecular optimization (MO) is a crucial stage in drug discovery in which task-oriented generated molecules are optimized to meet practical industrial requirements. Existing mainstream MO approaches primarily utilize external property predictors to guide iterative property optimization. However, learning all molecular samples in the vast chemical space is unrealistic for predictors. As a result, errors and noise are inevitably introduced during property prediction due to the nature of approximation. This leads to discrepancy accumulation, generalization reduction and suboptimal molecular candidates. In this paper, we propose a text-guided multi-property molecular optimization method utilizing transformer-based diffusion language model (TransDLM). TransDLM leverages standardized chemical nomenclature as semantic representations of molecules and implicitly embeds property requirements into textual descriptions, thereby mitigating error propagation during diffusion process. By fusing physically and chemically detailed textual semantics with specialized molecular representations, TransDLM effectively integrates diverse information sources to guide precise optimization, which enhances the model's ability to balance structural retention and property enhancement. Additionally, the success of a case study further demonstrates TransDLM's ability to solve practical problems. Experimentally, our approach surpasses state-of-the-art methods in maintaining molecular structural similarity and enhancing chemical properties on the benchmark dataset.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 37 of its 82 references that are in the map. First posted on arXiv 17 Oct 2024.

Builds on

37 of 82 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Text-Guided Molecule Generation with Diffusion Language Model20 Feb
  2. 2022Equivariant Diffusion for Molecule Generation in 3D31 Mar

Other references · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  7. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  8. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  9. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  10. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  11. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
  12. 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 652
23 more
  1. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
  2. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 516
  3. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
  4. 2022A Survey on Generative Diffusion Modelcited by 240
  5. 2022DiffusionBERT: Improving Generative Masked Language Models with Diffusion Modelscited by 214
  6. 2018Optimization of Molecules via Deep Reinforcement Learningcited by 200
  7. 2018Fr'echet ChemNet Distance: A metric for generative models for molecules in drug discoverycited by 194
  8. 2020MoFlow: An Invertible Flow Model for Generating Molecular Graphscited by 185
  9. 2022Translation between Molecules and Natural Languagecited by 177
  10. 20233D Equivariant Diffusion for Target-Aware Molecule Generation and Affinity Predictioncited by 177
  11. 2022Self-conditioned Embedding Diffusion for Text Generationcited by 117
  12. 2021Few-Shot Graph Learning for Molecular Property Predictioncited by 81
  13. 2018Molecular generative model based on conditional variational autoencoder for de novo molecular designcited by 73
  14. 2021Hit and Lead Discovery with Explorative RL and Fragment-based Molecule Generationcited by 68
  15. 2019Mol-CycleGAN - a generative model for molecular optimizationcited by 66
  16. 2022SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformerscited by 64
  17. 2021Molecule Generation by Principal Subgraph Mining and Assemblingcited by 54
  18. 2020Optimizing Molecules using Efficient Queries from Property Evaluationscited by 50
  19. 2020MIMOSA: Multi-constraint Molecule Sampling for Molecule Optimizationcited by 49
  20. 2022DiffusER: Discrete Diffusion via Edit-based Reconstructioncited by 41
  21. 2020A Deep Generative Model for Molecule Optimization via One Fragment Modificationcited by 37
  22. 2020A deep-learning view of chemical space designed to facilitate drug discoverycited by 7
  23. 2023A Federated Learning Benchmark for Drug-Target Interactioncited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 4.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 20243M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generation
  2. 2025Chain-of-Generation: Progressive Latent Diffusion for Text-Guided Molecular Design
  3. 2026MolDA: Molecular Understanding and Generation via Large Language Diffusion Model
  4. 2023Beyond Chemical Language: A Multimodal Approach to Enhance Molecular Property Prediction
  5. 2026CAGenMol: Condition-Aware Diffusion Language Model for Goal-Directed Molecular Generation
  6. 2024SmileyLlama: Modifying Large Language Models for Directed Chemical Space Exploration
  7. 2026DrugR: Optimizing Molecular Drugs through LLM-based Explicit Reasoning
  8. 2025MT-Mol:Multi Agent System with Tool-based Reasoning for Molecular Optimization