mlsanityData to 14 Oct 2026

MolDA: Molecular Understanding and Generation via Large Language Diffusion Model

arXiv 2604.04403 ↗First posted 6 Apr 2026cs.AIcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Large Language Models (LLMs) have significantly advanced molecular discovery, but existing multimodal molecular architectures fundamentally rely on autoregressive (AR) backbones. This strict left-to-right inductive bias is sub-optimal for generating chemically valid molecules, as it struggles to account for non-local global constraints (e.g., ring closures) and often accumulates structural errors during sequential generation. To address these limitations, we propose MolDA (Molecular language model with masked Diffusion with mAsking), a novel multimodal framework that replaces the conventional AR backbone with a discrete Large Language Diffusion Model. MolDA extracts comprehensive structural representations using a hybrid graph encoder, which captures both local and global topologies, and aligns them into the language token space via a Q-Former. Furthermore, we mathematically reformulate Molecular Structure Preference Optimization specifically for the masked diffusion. Through bidirectional iterative denoising, MolDA ensures global structural coherence, chemical validity, and robust reasoning across molecule generation, captioning, and property prediction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 19 of its 22 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

19 of 22 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Text-Guided Molecule Generation with Diffusion Language Model20 Feb
  2. 2022Structure-based Drug Design with Equivariant Diffusion Models24 Oct
  3. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation6 Mar

Other references · 16

  1. 2019Strategies for Pre-training Graph Neural Networkscited by 971
  2. 2025Large Language Diffusion Modelscited by 912
  3. 2024Simple and Effective Masked Diffusion Language Modelscited by 848
  4. 2022Galactica: A Large Language Model for Sciencecited by 744
  5. 2022Pure Transformers are Powerful Graph Learnerscited by 188
  6. 2022Translation between Molecules and Natural Languagecited by 177
  7. 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 133
  8. 2023MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adaptercited by 128
  9. 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 128
  10. 2024Towards 3D Molecule-Text Interpretation in Language Modelscited by 66
  11. 2024Developing ChemDFM as a large language foundation model for chemistrycited by 52
  12. 2024MolTC: Towards Molecular Relational Modeling In Language Modelscited by 22
4 more
  1. 2024LLaMo: Large Language Model-based Molecular Graph Assistantcited by 22
  2. 2024Structural Reasoning Improves Molecular Understanding of LLMcited by 11
  3. 2024From Generalist to Specialist: A Survey of Large Language Models for Chemistrycited by 11
  4. 2025Mol-LLM: Multimodal Generalist Molecular LLM with Improved Graph Utilizationcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 20243M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generation
  2. 2025Chain-of-Generation: Progressive Latent Diffusion for Text-Guided Molecular Design
  3. 2026CAGenMol: Condition-Aware Diffusion Language Model for Goal-Directed Molecular Generation
  4. 2024LDMol: A Text-to-Molecule Diffusion Model with Structurally Informative Latent Space Surpasses AR Models
  5. 2024A quantitative analysis of knowledge-learning preferences in large language models in molecular science
  6. 2025NovoMolGen: Rethinking Molecular Language Model Pretraining
  7. 2026MoleCode unlocks structural intelligence in large language models
  8. 2024Text-guided multi-property molecular optimization with a diffusion language model