Bridging Foundation Models and ASTM Metallurgical Standards for Automated Grain Size Estimation from Microscopy Images
Not on the map. Why?
Abstract (arXiv)
Extracting standardized metallurgical metrics from microscopy images remains challenging due to complex grain morphology and the data demands of supervised segmentation. To bridge foundational computer vision with practical metallurgical evaluation, we propose an automated pipeline for dense instance segmentation and grain size estimation that adapts Cellpose-SAM to microstructures and integrates its topology-aware gradient tracking with an ASTM E112 Jeffries planimetric module. We systematically benchmark this pipeline against a classical convolutional network (U-Net), an adaptive-prompting vision foundation model (MatSAM) and a contemporary vision-language model (Qwen2.5-VL-7B). Our evaluations reveal that while the out-of-the-box vision-language model struggles with the localized spatial reasoning required for dense microscopic counting and MatSAM suffers from over-segmentation despite its domain-specific prompt generation, our adapted pipeline successfully maintains topological separation. Furthermore, experiments across progressively reduced training splits demonstrate exceptional few-shot scalability; utilizing only two training samples, the proposed system predicts the ASTM grain size number (G) with a mean absolute percentage error (MAPE) as low as 1.50%, while robustness testing across varying target grain counts empirically validates the ASTM 50-grain sampling minimum. These results highlight the efficacy of application-level foundation model integration for highly accurate, automated materials characterization. Our project repository is available at https://github.com/mueez-overflow/ASTM-Grain-Size-Estimator.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 35 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
8 of 35 references.
References · 8
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023Segment Anythingcited by 8,234
- 2020Pretrained Transformers Improve Out-of-Distribution Robustnesscited by 294
- 2024NaturalBench: Evaluating Vision-Language Models on Natural Adversarial Samplescited by 97
- 2025Vision Language Models are Biasedcited by 66
- 2024LVLM-COUNT: Enhancing the Counting Ability of Large Vision-Language Modelscited by 20
- 2021Optimized and autonomous machine learning framework for characterizing pores, particles, grains and grain boundaries in microstructural imagescited by 5
- 2023Grain and Grain Boundary Segmentation using Machine Learning with Real and Generated Datasetscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Novel Concept-Oriented Synthetic Data approach for Training Generative AI-Driven Crystal Grain Analysis Using Diffusion Model
- 2025EM3M: An Electron Micrograph Dataset for Microstructural Segmentation and Generation
- 2024Foundational Model for Electron Micrograph Analysis: Instruction-Tuning Small-Scale Language-and-Vision Assistant for Enterprise Adoption
- 2026A Mixture of Experts Foundation Model for Scanning Electron Microscopy Image Analysis
- 2024Parameter-Efficient Quantized Mixture-of-Experts Meets Vision-Language Instruction Tuning for Semiconductor Electron Micrograph Analysis
- 2024Multi-Modal Instruction-Tuning Small-Scale Language-and-Vision Assistant for Semiconductor Electron Micrograph Analysis
- 2025Parameter-aware high-fidelity microstructure generation using stable diffusion
- 2025GrainPaint: A multi-scale diffusion-based generative model for microstructure reconstruction of large-scale objects