mlsanityData to 7 Oct 2026

Composable Crystals: Controllable Materials Discovery via Concept Learning

arXiv 2605.14769 ↗First posted 14 May 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

De novo crystal generation, a central task in materials discovery, aims to generate crystals that are simultaneously valid, stable, unique, and novel. Existing methods mainly rely on black-box stochastic sampling, providing limited control over how generated structures move beyond the observed distribution. In this paper, we introduce a concept-based compositional framework for crystal generation. We train a vector-quantized variational autoencoder to automatically discover a shared set of reusable crystal concepts, which serve as building blocks for guided generation. These learned concepts naturally exhibit interpretability from both local atomic environments and global symmetry patterns, and generalize to crystals from different distributions. By recombining such concepts, our framework enables controllable exploration of novel crystals beyond the training distribution, rather than relying solely on unconstrained random sampling. To further improve composition efficiency, we introduce a composition generator and iteratively refine it using high-quality samples generated by the model itself. The resulting concept compositions are then used to condition downstream crystal generation. Numerical experiments on MP-20 and Alex-MP-20 show that compositing concepts separately increase base model up to 53.2% and 51.7% on V.S.U.N metric, with particular gains in novelty.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 43 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

32 of 43 references.

References · 32

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2017Neural Discrete Representation Learningcited by 4,650
  10. 2024GPT-4o System Cardcited by 4,467
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  12. 2020On Layer Normalization in the Transformer Architecturecited by 906
20 more
  1. 2020A Generalization of Transformer Networks to Graphscited by 653
  2. 2021Crystal Diffusion Variational Autoencoder for Periodic Material Generationcited by 268
  3. 2023Geometric Latent Diffusion Models for 3D Molecule Generationcited by 185
  4. 2023Crystal Structure Prediction by Joint Equivariant Diffusioncited by 142
  5. 2024FlowMM: Generating Materials with Riemannian Flow Matchingcited by 105
  6. 2023Specformer: Spectral Graph Neural Networks Meet Transformerscited by 102
  7. 2023MatterGen: a generative model for inorganic materials designcited by 98
  8. 2024Fine-Tuned Language Models Generate Stable Inorganic Materials as Textcited by 92
  9. 2025All-atom Diffusion Transformers: Unified generative modelling of molecules and materialscited by 75
  10. 2024Space Group Constrained Crystal Generationcited by 71
  11. 2023Skill-Mix: a Flexible and Expandable Family of Evaluations for AI modelscited by 64
  12. 2024ConceptMix: A Compositional Image Generation Benchmark with Controllable Difficultycited by 60
  13. 2024FlowLLM: Flow Matching for Material Generation with Large Language Models as Base Distributionscited by 52
  14. 2025SymmCD: Symmetry-Preserving Crystal Generation with Diffusion Modelscited by 48
  15. 2024Space Group Informed Transformer for Crystalline Materials Generationcited by 40
  16. 2024Can Large Language Models Improve the Adversarial Robustness of Graph Neural Networks?cited by 22
  17. 2025Space Group Equivariant Crystal Diffusioncited by 15
  18. 2025LLM Meets Diffusion: A Hybrid Framework for Crystal Material Generationcited by 12
  19. 2025What-If Analysis of Large Language Models: Explore the Game World Using Proactive Thinkingcited by 3
  20. 2026Graph-GRPO: Training Graph Flow Models with Reinforcement Learningcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.