Phase-fraction guided denoising diffusion model for augmenting multiphase steel microstructure segmentation via micrograph image-mask pair synthesis
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
The effectiveness of machine learning in metallographic microstructure segmentation is often constrained by the lack of human-annotated phase masks, particularly for rare or compositionally complex morphologies within the metal alloy. We introduce PF-DiffSeg, a phase-fraction controlled, one-stage denoising diffusion framework that jointly synthesizes microstructure images and their corresponding segmentation masks in a single generative trajectory to further improve segmentation accuracy. By conditioning on global phase-fraction vectors, augmented to represent real data distribution and emphasize minority classes, our model generates compositionally valid and structurally coherent microstructure image and mask samples that improve both data diversity and training efficiency. Evaluated on the MetalDAM benchmark for additively manufactured multiphase steel, our synthetic augmentation method yields notable improvements in segmentation accuracy compared to standard augmentation strategies especially in minority classes and further outperforms a two-stage mask-guided diffusion and generative adversarial network (GAN) baselines, while also reducing inference time compared to conventional approach. The method integrates generation and conditioning into a unified framework, offering a scalable solution for data augmentation in metallographic applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 16 of its 36 references that are in the map. First posted on arXiv 28 Jul 2025.
Builds on
16 of 36 references.
Closest ancestors · 1
Same direction, newest first
Other references · 15
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Generative Adversarial Networkscited by 5,627
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2017LinkNet: Exploiting Encoder Representations for Efficient Semantic Segmentationcited by 214
- 2024Anatomically-Controllable Medical Image Generation with Segmentation-Guided Diffusion Modelscited by 69
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentationcited by 41
- 2018High throughput quantitative metallography for complex microstructures using deep learning: A case study in ultrahigh carbon steelcited by 19
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties
- 2026Improving Combined Detection and Classification of TEM Defects via Mask-Conditioned Latent Diffusion Augmentation
- 2023Denoising diffusion-based synthetic generation of three-dimensional (3D) anisotropic microstructures from two-dimensional (2D) micrographs
- 2025MicroLad: 2D-to-3D Microstructure Reconstruction and Generation via Latent Diffusion and Score Distillation
- 2025Parameter-aware high-fidelity microstructure generation using stable diffusion
- 2023Multi-plane denoising diffusion-based dimensionality expansion for 2D-to-3D reconstruction of microstructures with harmonized sampling
- 2026C4-Equivariant Flow Matching on Anisotropic Power-Diagram Graphs for Microstructure Generation
- 2024A Large Language Model and Denoising Diffusion Framework for Targeted Design of Microstructures with Commands in Natural Language