mlsanityData to 14 Oct 2026

Phase-fraction guided denoising diffusion model for augmenting multiphase steel microstructure segmentation via micrograph image-mask pair synthesis

arXiv 2508.00896 ↗First posted 28 Jul 2025cs.CV cond-mat.mtrl-sci eess.IVcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

The effectiveness of machine learning in metallographic microstructure segmentation is often constrained by the lack of human-annotated phase masks, particularly for rare or compositionally complex morphologies within the metal alloy. We introduce PF-DiffSeg, a phase-fraction controlled, one-stage denoising diffusion framework that jointly synthesizes microstructure images and their corresponding segmentation masks in a single generative trajectory to further improve segmentation accuracy. By conditioning on global phase-fraction vectors, augmented to represent real data distribution and emphasize minority classes, our model generates compositionally valid and structurally coherent microstructure image and mask samples that improve both data diversity and training efficiency. Evaluated on the MetalDAM benchmark for additively manufactured multiphase steel, our synthetic augmentation method yields notable improvements in segmentation accuracy compared to standard augmentation strategies especially in minority classes and further outperforms a two-stage mask-guided diffusion and generative adversarial network (GAN) baselines, while also reducing inference time compared to conventional approach. The method integrates generation and conditioning into a unified framework, offering a scalable solution for data augmentation in metallographic applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 16 of its 36 references that are in the map. First posted on arXiv 28 Jul 2025.

Builds on

16 of 36 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025GrainPaint: A multi-scale diffusion-based generative model for microstructure reconstruction of large-scale objects18 Feb

Other references · 15

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2022Generative Adversarial Networkscited by 5,627
  7. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
  8. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  9. 2017LinkNet: Exploiting Encoder Representations for Efficient Semantic Segmentationcited by 214
  10. 2024Anatomically-Controllable Medical Image Generation with Segmentation-Guided Diffusion Modelscited by 69
  11. 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentationcited by 41
  12. 2018High throughput quantitative metallography for complex microstructures using deep learning: A case study in ultrahigh carbon steelcited by 19
3 more
  1. 2022One-Shot Synthesis of Images and Segmentation Maskscited by 4
  2. 2023Denoising Diffusion Probabilistic Model for Retinal Image Generation and Segmentationcited by 4
  3. 2021Establishing process-structure linkages using Generative Adversarial Networkscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties
  2. 2026Improving Combined Detection and Classification of TEM Defects via Mask-Conditioned Latent Diffusion Augmentation
  3. 2023Denoising diffusion-based synthetic generation of three-dimensional (3D) anisotropic microstructures from two-dimensional (2D) micrographs
  4. 2025MicroLad: 2D-to-3D Microstructure Reconstruction and Generation via Latent Diffusion and Score Distillation
  5. 2025Parameter-aware high-fidelity microstructure generation using stable diffusion
  6. 2023Multi-plane denoising diffusion-based dimensionality expansion for 2D-to-3D reconstruction of microstructures with harmonized sampling
  7. 2026C4-Equivariant Flow Matching on Anisotropic Power-Diagram Graphs for Microstructure Generation
  8. 2024A Large Language Model and Denoising Diffusion Framework for Targeted Design of Microstructures with Commands in Natural Language