Denoising diffusion-based synthetic generation of three-dimensional (3D) anisotropic microstructures from two-dimensional (2D) micrographs
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Integrated computational materials engineering (ICME) has significantly enhanced the systemic analysis of the relationship between microstructure and material properties, paving the way for the development of high-performance materials. However, analyzing microstructure-sensitive material behavior remains challenging due to the scarcity of three-dimensional (3D) microstructure datasets. Moreover, this challenge is amplified if the microstructure is anisotropic, as this results in anisotropic material properties as well. In this paper, we present a framework for reconstruction of anisotropic microstructures solely based on two-dimensional (2D) micrographs using conditional diffusion-based generative models (DGMs). The proposed framework involves spatial connection of multiple 2D conditional DGMs, each trained to generate 2D microstructure samples for three different orthogonal planes. The connected multiple reverse diffusion processes then enable effective modeling of a Markov chain for transforming noise into a 3D microstructure sample. Furthermore, a modified harmonized sampling is employed to enhance the sample quality while preserving the spatial connection between the slices of anisotropic microstructure samples in 3D space. To validate the proposed framework, the 2D-to-3D reconstructed anisotropic microstructure samples are evaluated in terms of both the spatial correlation function and the physical material behavior. The results demonstrate that the framework is capable of reproducing not only the statistical distribution of material phases but also the material properties in 3D space. This highlights the potential application of the proposed 2D-to-3D reconstruction framework in establishing microstructure-property linkages, which could aid high-throughput material design for future studies
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 25 of its 73 references that are in the map. First posted on arXiv 13 Dec 2023.
Builds on
25 of 73 references.
Closest ancestors · 1
Same direction, newest first
Other references · 24
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2021Transformers in Vision: A Surveycited by 1,013
12 more
- 2022Denoising Diffusion Restoration Modelscited by 963
- 2017Wasserstein Auto-Encoderscited by 373
- 2021Score-based diffusion models for accelerated MRIcited by 311
- 2017VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learningcited by 200
- 2022MR Image Denoising and Super-Resolution Using Regularized Reverse Diffusioncited by 67
- 2017Towards Deeper Understanding of Variational Autoencoding Modelscited by 56
- 2021Stochastic Image Denoising by Sampling from the Posterior Distributioncited by 45
- 2021Generating 3D structures from a 2D slice with GAN-based dimensionality expansioncited by 29
- 2018A Transfer Learning Approach for Microstructure Reconstruction and Structure-property Predictionscited by 21
- 2016Microstructure Representation and Reconstruction of Heterogeneous Materials via Deep Belief Network for Computational Material Designcited by 12
- 2022Three-dimensional microstructure generation using generative adversarial neural networks in the context of continuum micromechanicscited by 11
- 2019Microstructure synthesis using style-based generative adversarial networkcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties
- 2025MicroLad: 2D-to-3D Microstructure Reconstruction and Generation via Latent Diffusion and Score Distillation
- 2025GrainPaint: A multi-scale diffusion-based generative model for microstructure reconstruction of large-scale objects
- 2025Parameter-aware high-fidelity microstructure generation using stable diffusion
- 2026Generating Heterogeneous 3D Geological Microstructures from 2D Images via a Stable Diffusion-Adversarial Model
- 2024A Large Language Model and Denoising Diffusion Framework for Targeted Design of Microstructures with Commands in Natural Language
- 2026C4-Equivariant Flow Matching on Anisotropic Power-Diagram Graphs for Microstructure Generation
- 2025Phase-fraction guided denoising diffusion model for augmenting multiphase steel microstructure segmentation via micrograph image-mask pair synthesis