mlsanityData to 7 Oct 2026

Periodic Materials Generation using Text-Guided Joint Diffusion Model

arXiv 2503.00522 ↗First posted 1 Mar 2025cs.LG cond-mat.mtrl-scicited by 15

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Equivariant diffusion models have emerged as the prevailing approach for generating novel crystal materials due to their ability to leverage the physical symmetries of periodic material structures. However, current models do not effectively learn the joint distribution of atom types, fractional coordinates, and lattice structure of the crystal material in a cohesive end-to-end diffusion framework. Also, none of these models work under realistic setups, where users specify the desired characteristics that the generated structures must match. In this work, we introduce TGDMat, a novel text-guided diffusion model designed for 3D periodic material generation. Our approach integrates global structural knowledge through textual descriptions at each denoising step while jointly generating atom coordinates, types, and lattice structure using a periodic-E(3)-equivariant graph neural network (GNN). Extensive experiments using popular datasets on benchmark tasks reveal that TGDMat outperforms existing baseline methods by a good margin. Notably, for the structure prediction task, with just one generated sample, TGDMat outperforms all baseline models, highlighting the importance of text-guided diffusion. Further, in the generation task, TGDMat surpasses all baselines and their text-fusion variants, showcasing the effectiveness of the joint diffusion paradigm. Additionally, incorporating textual knowledge reduces overall training and sampling computational overhead while enhancing generative performance when utilizing real-world textual prompts from experts.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 41 of its 73 references that are in the map. First posted on arXiv 1 Mar 2025.

Builds on

41 of 73 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024Text-guided Diffusion Model for 3D Molecule Generation4 Oct
  2. 2024Text-Guided Molecule Generation with Diffusion Language Model20 Feb
  3. 2023Crystal Structure Prediction by Joint Equivariant Diffusion30 Jul
  4. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation6 Mar

Other references · 37

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  11. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
25 more
  1. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  2. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  3. 2021E(n) Equivariant Graph Neural Networkscited by 951
  4. 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
  5. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  6. 2022A Continuous Time Framework for Discrete Denoising Modelscited by 437
  7. 2022AudioGen: Textually Guided Audio Generationcited by 292
  8. 2021Crystal Diffusion Variational Autoencoder for Periodic Material Generationcited by 268
  9. 2022Diffsound: Discrete Diffusion Model for Text-to-sound Generationcited by 256
  10. 2022Riemannian Score-Based Generative Modellingcited by 216
  11. 2021Learning Gradient Fields for Molecular Conformation Generationcited by 162
  12. 2021GeoMol: Torsional Geometric Generation of Molecular 3D Conformer Ensemblescited by 106
  13. 2024FlowMM: Generating Materials with Riemannian Flow Matchingcited by 105
  14. 2023MatterGen: a generative model for inorganic materials designcited by 98
  15. 2021Inverse design of 3d molecular structures with conditional generative neural networkscited by 93
  16. 2024Fine-Tuned Language Models Generate Stable Inorganic Materials as Textcited by 92
  17. 2022Periodic Graph Transformers for Crystal Material Property Predictioncited by 87
  18. 2021GraphEBM: Molecular Graph Generation with Energy-Based Modelscited by 85
  19. 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 82
  20. 2024Space Group Constrained Crystal Generationcited by 71
  21. 2023Scalable Diffusion for Materials Generationcited by 52
  22. 2019Data-Driven Approach to Encoding and Decoding 3-D Crystal Structurescited by 34
  23. 2023Towards Symmetry-Aware Generation of Periodic Materialscited by 25
  24. 2023CrysMMNet: Multimodal Representation for Crystal Property Predictioncited by 18
  25. 2023CrysGNN : Distilling pre-trained knowledge to enhance property prediction for crystalline materialscited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 7.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2023Vector Field Oriented Diffusion Model for Crystal Material Generation
  2. 2026Crystalite: A Lightweight Transformer for Efficient Crystal Modeling
  3. 2025CrystalGRW: Generative Modeling of Crystal Structures with Targeted Properties via Geodesic Random Walks
  4. 2025Kinetic Langevin Diffusion for Crystalline Materials Generation
  5. 2024Generative Inverse Design of Crystal Structures via Diffusion Models with Transformers
  6. 2024Grand canonical generative diffusion model for crystalline phases and grain boundaries
  7. 2025WyckoffDiff -- A Generative Diffusion Model for Crystal Symmetry
  8. 2025Open Materials Generation with Stochastic Interpolants