# Algebraic Language Models for Inverse Design of Metamaterials via Diffusion Transformers

arXiv: https://arxiv.org/abs/2507.15753 · HTML: https://mlsanity.com/paper/2507.15753/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Placed in Flow matching, time series and science, one of 14 directions in Diffusion models.
- Builds on 28 of its 79 references that are in the map.
- First posted on arXiv 21 Jul 2025.

## Placed in

- Diffusion models / [Flow matching, time series and science](https://mlsanity.com/diffusion/flow-matching-time-series-and-science/)

## Builds on (most cited first, 28 of 28)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [High-Resolution Image Synthesis with Latent Diffusion Models](https://mlsanity.com/paper/2112.10752/) (2021)
- [Score-Based Generative Modeling through Stochastic Differential Equations](https://mlsanity.com/paper/2011.13456/) (2020)
- [Scalable Diffusion Models with Transformers](https://mlsanity.com/paper/2212.09748/) (2022)
- [Classifier-Free Diffusion Guidance](https://mlsanity.com/paper/2207.12598/) (2022)
- [Generative Adversarial Networks](https://mlsanity.com/paper/2203.00667/) (2022)
- [Diffusion-LM Improves Controllable Text Generation](https://mlsanity.com/paper/2205.14217/) (2022)
- [Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning](https://mlsanity.com/paper/1702.03118/) (2017)
- [Diffusion Probabilistic Models for 3D Point Cloud Generation](https://mlsanity.com/paper/2103.01458/) (2021)
- [AI Feynman: a Physics-Inspired Method for Symbolic Regression](https://mlsanity.com/paper/1905.11481/) (2019)
- [MeshDiffusion: Score-based Generative 3D Mesh Modeling](https://mlsanity.com/paper/2303.08133/) (2023)
- [A Practical Survey on Faster and Lighter Transformers](https://mlsanity.com/paper/2103.14636/) (2021)
- [A Comprehensive Survey on Applications of Transformers for Deep Learning Tasks](https://mlsanity.com/paper/2306.07303/) (2023)
- [Inverse-design of nonlinear mechanical metamaterials via video denoising diffusion models](https://mlsanity.com/paper/2305.19836/) (2023)
- [BayesDiff: Estimating Pixel-wise Uncertainty in Diffusion via Bayesian Inference](https://mlsanity.com/paper/2310.11142/) (2023)
- [Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties](https://mlsanity.com/paper/2302.12881/) (2023)
- [Data-driven topology optimization of spinodoid metamaterials with seamlessly tunable anisotropy](https://mlsanity.com/paper/2012.15744/) (2020)
- [Generative Uncertainty in Diffusion Models](https://mlsanity.com/paper/2502.20946/) (2025)
- [Unifying the design space and optimizing linear and nonlinear truss metamaterials by generative modeling](https://mlsanity.com/paper/2306.14773/) (2023)
- [IH-GAN: A Conditional Generative Model for Implicit Surface-Based Inverse Design of Cellular Structures](https://mlsanity.com/paper/2103.02588/) (2021)
- [Computing multiple solutions of topology optimization problems](https://mlsanity.com/paper/2004.11797/) (2020)
- [A Large Language Model and Denoising Diffusion Framework for Targeted Design of Microstructures with Commands in Natural Language](https://mlsanity.com/paper/2409.14473/) (2024)
- [Experiment-informed finite-strain inverse design of spinodal metamaterials](https://mlsanity.com/paper/2312.11648/) (2023)
- [Data-Efficient Discovery of Hyperelastic TPMS Metamaterials with Extreme Energy Dissipation](https://mlsanity.com/paper/2405.19507/) (2024)
- [Inverse Design of Metamaterials with Manufacturing-Guiding Spectrum-to-Structure Conditional Diffusion Model](https://mlsanity.com/paper/2506.07083/) (2025)
- [Topology Optimization of Graded Truss Lattices Based on On-the-Fly Homogenization](https://mlsanity.com/paper/2205.14366/) (2022)

## Built on by (most cited first, 5 of 5)

- [Co-PiLOT: Constrained Physics-Informed Latent Optimization for Target-Driven Inverse Design](https://mlsanity.com/paper/2609.37875/) (2026)
- [Generative AI for material design: A mechanics perspective from burgers to matter](https://mlsanity.com/paper/2604.03409/) (2026)
- [Property-Informed Diffusion-Based Text-to-Microstructure Generation](https://mlsanity.com/paper/2606.08150/) (2026)
- [CertMix: Certified, Data-Efficient Metamaterial Design by Affine Mixing of Aligned Neural-Implicit Weight Spaces](https://mlsanity.com/paper/2607.04123/) (2026)
- [A property-registry contract for retrieve-or-refuse thermal-mechanical lattice search](https://mlsanity.com/paper/2609.14741/) (2026)

## Abstract (arXiv)

Generative machine learning models have revolutionized material discovery by capturing complex structure-property relationships, yet extending these approaches to the inverse design of three-dimensional metamaterials remains limited by computational complexity and underexplored design spaces due to the lack of expressive representations. Here we present DiffuMeta, a generative framework integrating diffusion transformers with an algebraic language representation, encoding three-dimensional geometries as mathematical sentences. This compact, unified parameterization spans diverse topologies, enabling the direct application of transformers to structural design. DiffuMeta leverages diffusion models to generate new shell structures with precisely targeted stress-strain responses under large deformations, accounting for buckling and contact while addressing the inherent one-to-many mapping by producing diverse solutions. Uniquely, our approach enables simultaneous control over multiple mechanical objectives, including linear and nonlinear responses beyond training domains. Experimental validation of fabricated structures further confirms the efficacy of our approach for accelerated design of metamaterials and structures with tailored properties.