Overview: Computer vision and machine learning for microstructural characterization and analysis
Not on the map. Why?
Abstract (arXiv)
The characterization and analysis of microstructure is the foundation of microstructural science, connecting the materials structure to its composition, process history, and properties. Microstructural quantification traditionally involves a human deciding a priori what to measure and then devising a purpose-built method for doing so. However, recent advances in data science, including computer vision (CV) and machine learning (ML) offer new approaches to extracting information from microstructural images. This overview surveys CV approaches to numerically encode the visual information contained in a microstructural image, which then provides input to supervised or unsupervised ML algorithms that find associations and trends in the high-dimensional image representation. CV/ML systems for microstructural characterization and analysis span the taxonomy of image analysis tasks, including image classification, semantic segmentation, object detection, and instance segmentation. These tools enable new approaches to microstructural analysis, including the development of new, rich visual metrics and the discovery of processing-microstructure-property relationships.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 3; 2024: 2; 2025: 6; 2026: 5.
22 papers.
Sort:
By area:
- 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responsescited by 18
- 2023Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Reviewcited by 15
- 2025Can Multimodal LLMs See Materials Clearly? A Multimodal Benchmark on Materials Characterizationcited by 8
- 2021An End-to-End Computer Vision Methodology for Quantitative Metallographycited by 3
- 2022Computer Vision Methods for the Microstructural Analysis of Materials: The State-of-the-art and Future Perspectivescited by 2
- 2021Graph convolutional network for predicting abnormal grain growth in Monte Carlo simulations of microstructural evolutioncited by 1
- 2022Digital Fingerprinting of Microstructurescited by 1
- 2025Deep Learning-Driven Prediction of Microstructure Evolution via Latent Space Interpolationcited by 1
- 2025Reward driven discovery of the optimal microstructure representations with invariant variational autoencoderscited by 1
- 2026Context Determines Optimal Architecture in Materials Segmentationcited by 1
- 2021Performance, Successes and Limitations of Deep Learning Semantic Segmentation of Multiple Defects in Transmission Electron Micrographscited by 0
- 2022Computational Discovery of Energy-Efficient Heat Treatment for Microstructure Design using Deep Reinforcement Learningcited by 0
10 more
- 2023Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopycited by 0
- 2023Procedural Generation of Grain Orientations using the Wave Function Collapse Algorithmcited by 0
- 2024A versatile machine learning workflow for high-throughput analysis of supported metal catalyst particlescited by 0
- 2025Predicting Performance of Object Detection Models in Electron Microscopy Using Random Forestscited by 0
- 20253D variational autoencoder for fingerprinting microstructure volume elementscited by 0
- 2025MicroLad: 2D-to-3D Microstructure Reconstruction and Generation via Latent Diffusion and Score Distillationcited by 0
- 2026Improving Combined Detection and Classification of TEM Defects via Mask-Conditioned Latent Diffusion Augmentationcited by 0
- 2026Speeding up the annotation process in semantic segmentation industrial applicationscited by 0
- 2026Physics as the label for measuring and correcting materials reasoning in multimodal modelscited by 0
- 2026Inferring Dislocation Microstructures from X-ray Diffraction via Cross-Modal Contrastive Learningcited by 0
- 2026Inferring Dislocation Microstructures from X-ray Diffraction via Cross-Modal Contrastive Learning11 Sep 2026
- 2026Physics as the label for measuring and correcting materials reasoning in multimodal models10 Sep 2026
- 2026Speeding up the annotation process in semantic segmentation industrial applications18 Jun 2026
- 2026Improving Combined Detection and Classification of TEM Defects via Mask-Conditioned Latent Diffusion Augmentation1 Jun 2026
- 2026Context Determines Optimal Architecture in Materials Segmentation4 Feb 2026
- 2025Reward driven discovery of the optimal microstructure representations with invariant variational autoencoders30 Sep 2025
- 2025Can Multimodal LLMs See Materials Clearly? A Multimodal Benchmark on Materials Characterization11 Sep 2025
- 2025MicroLad: 2D-to-3D Microstructure Reconstruction and Generation via Latent Diffusion and Score Distillation27 Aug 2025
- 2025Deep Learning-Driven Prediction of Microstructure Evolution via Latent Space Interpolation3 Aug 2025
- 20253D variational autoencoder for fingerprinting microstructure volume elements21 Mar 2025
- 2025Predicting Performance of Object Detection Models in Electron Microscopy Using Random Forests14 Jan 2025
- 2024A versatile machine learning workflow for high-throughput analysis of supported metal catalyst particles2 Oct 2024
10 more
- 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responses11 Jan 2024
- 2023Procedural Generation of Grain Orientations using the Wave Function Collapse Algorithm21 Nov 2023
- 2023Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopy12 May 2023
- 2023Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Review14 Mar 2023
- 2022Computational Discovery of Energy-Efficient Heat Treatment for Microstructure Design using Deep Reinforcement Learning22 Sep 2022
- 2022Computer Vision Methods for the Microstructural Analysis of Materials: The State-of-the-art and Future Perspectives29 Jul 2022
- 2022Digital Fingerprinting of Microstructures25 Mar 2022
- 2021Graph convolutional network for predicting abnormal grain growth in Monte Carlo simulations of microstructural evolution18 Oct 2021
- 2021Performance, Successes and Limitations of Deep Learning Semantic Segmentation of Multiple Defects in Transmission Electron Micrographs15 Oct 2021
- 2021An End-to-End Computer Vision Methodology for Quantitative Metallography22 Apr 2021
- 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responsescited by 18
- 2023Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Reviewcited by 15
- 2021An End-to-End Computer Vision Methodology for Quantitative Metallographycited by 3
- 2022Computer Vision Methods for the Microstructural Analysis of Materials: The State-of-the-art and Future Perspectivescited by 2
- 2021Graph convolutional network for predicting abnormal grain growth in Monte Carlo simulations of microstructural evolutioncited by 1
- 2022Digital Fingerprinting of Microstructurescited by 1
- 2025Deep Learning-Driven Prediction of Microstructure Evolution via Latent Space Interpolationcited by 1
- 2025Reward driven discovery of the optimal microstructure representations with invariant variational autoencoderscited by 1
- 2026Context Determines Optimal Architecture in Materials Segmentationcited by 1
- 2021Performance, Successes and Limitations of Deep Learning Semantic Segmentation of Multiple Defects in Transmission Electron Micrographscited by 0
- 2022Computational Discovery of Energy-Efficient Heat Treatment for Microstructure Design using Deep Reinforcement Learningcited by 0
- 2023Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopycited by 0
12 most cited of 18 All 18 (JSON)
- 2026Inferring Dislocation Microstructures from X-ray Diffraction via Cross-Modal Contrastive Learning11 Sep 2026
- 2026Speeding up the annotation process in semantic segmentation industrial applications18 Jun 2026
- 2026Context Determines Optimal Architecture in Materials Segmentation4 Feb 2026
- 2025Reward driven discovery of the optimal microstructure representations with invariant variational autoencoders30 Sep 2025
- 2025Deep Learning-Driven Prediction of Microstructure Evolution via Latent Space Interpolation3 Aug 2025
- 20253D variational autoencoder for fingerprinting microstructure volume elements21 Mar 2025
- 2025Predicting Performance of Object Detection Models in Electron Microscopy Using Random Forests14 Jan 2025
- 2024A versatile machine learning workflow for high-throughput analysis of supported metal catalyst particles2 Oct 2024
- 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responses11 Jan 2024
- 2023Procedural Generation of Grain Orientations using the Wave Function Collapse Algorithm21 Nov 2023
- 2023Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopy12 May 2023
- 2023Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Review14 Mar 2023
12 newest of 18 All 18 (JSON)