Lang2Str: Two-Stage Crystal Structure Generation with LLMs and Continuous Flow Models
Not on the map. Why?
Abstract (arXiv)
Generative models hold great promise for accelerating material discovery but are often limited by their inflexible single-stage generative process in designing valid and diverse materials. To address this, we propose a two-stage generative framework, Lang2Str, that combines the strengths of large language models (LLMs) and flow-based models for flexible and precise material generation. Our method frames the generative process as a conditional generative task, where an LLM provides high-level conditions by generating descriptions of material unit cells' geometric layouts and properties. These descriptions, informed by the LLM's extensive background knowledge, ensure reasonable structure designs. A conditioned flow model then decodes these textual conditions into precise continuous coordinates and unit cell parameters. This staged approach combines the structured reasoning of LLMs and the distribution modeling capabilities of flow models. Experimental results show that our method achieves competitive performance on textitab initio material generation and crystal structure prediction tasks, with generated structures exhibiting closer alignment to ground truth in both geometry and energy levels, surpassing state-of-the-art models. The flexibility and modularity of our framework further enable fine-grained control over the generation process, potentially leading to more efficient and customizable material design.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
17 of 26 references.
References · 17
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2021Crystal Diffusion Variational Autoencoder for Periodic Material Generationcited by 270
- 2023Crystal Structure Prediction by Joint Equivariant Diffusioncited by 148
- 2024FlowMM: Generating Materials with Riemannian Flow Matchingcited by 109
- 2024Fine-Tuned Language Models Generate Stable Inorganic Materials as Textcited by 93
- 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 83
5 more
- 2024Space Group Constrained Crystal Generationcited by 73
- 2024FlowLLM: Flow Matching for Material Generation with Large Language Models as Base Distributionscited by 53
- 2024Number Cookbook: Number Understanding of Language Models and How to Improve Itcited by 42
- 2025Nature Language Model: Deciphering the Language of Nature for Scientific Discoverycited by 36
- 2022Crystal structure prediction with machine learning-based element substitutioncited by 17
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025LLM Meets Diffusion: A Hybrid Framework for Crystal Material Generation
- 2024Generative Hierarchical Materials Search
- 2026Text-guided flow matching enables sample-efficient crystal structure generation
- 2025Role of Large Language Models and Retrieval-Augmented Generation for Accelerating Crystalline Material Discovery: A Systematic Review
- 2026MatMind: A Structure-Activity Knowledge-Driven Generative Foundation Model for Materials Science
- 2024Foundational Large Language Models for Materials Research
- 2024Unleashing the power of novel conditional generative approaches for new materials discovery
- 2026CrystalReasoner: Reasoning and RL for Property-Conditioned Crystal Structure Generation