DCM-SAM: Defect-Conditioned Mixture of LoRA Experts for NPU-Deployed AM Defect Segmentation
Not on the map. Why?
Abstract (arXiv)
Metal additive manufacturing parts are inspected by X-ray computed tomography, where labelled data is scarce, the pores and inclusions that matter span a few pixels, and inspection must happen at the machine. We present DCM-SAM, a defect-conditioned adaptive mixture of LoRA experts: one frozen Segment Anything backbone carries a separate Conv-LoRA expert bank and mask decoder per defect class, each trained in its own pass, without prompts, on synthetic slices alone, updating only 4.4% of the parameters. On benchmarks that XCT-SAM reports, DCM-SAM improves on every baseline for both classes from a ViT-B backbone against their ViT-H, and reaches 64.2% pore IoU on real NIST scans having seen no real images during training. Deployment then exposes what adaptation work rarely measures: on a Qualcomm Hexagon NPU, ViT-H and ViT-L compile yet cannot allocate at 1024x1024 image resolution, since activations rather than weights exceed the device ceiling, and quantizing weights does not help. ViT-B alone runs, but the adapted encoder then fails to allocate where the stock one succeeds, until a numerically identical rewrite of the attention lets the complete DCM-SAM run in FP16 at 1024x1024, with no operator falling back to the CPU, masks within 0.01% of pixels of the FP32 reference. Code: https://github.com/MushfiqShovon/DCM-SAM.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 37 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
13 of 37 references.
References · 13
- 2023Segment Anythingcited by 8,234
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2020Up or Down? Adaptive Rounding for Post-Training Quantizationcited by 621
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 586
- 2021BRECQ: Pushing the Limit of Post-Training Quantization by Block Reconstructioncited by 479
- 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 352
- 2022QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantizationcited by 180
- 2018A Novel Focal Tversky loss function with improved Attention U-Net for lesion segmentationcited by 172
- 2024Convolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Modelcited by 69
- 2024PTQ4SAM: Post-Training Quantization for Segment Anythingcited by 32
- 2024Adapting Segment Anything Model (SAM) to Experimental Datasets via Fine-Tuning on GAN-based Simulation: A Case Study in Additive Manufacturingcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025From Lab to Factory: Pitfalls and Guidelines for Self-/Unsupervised Defect Detection on Low-Quality Industrial Images
- 2025Image-Intrinsic Priors for Integrated Circuit Defect Detection and Novel Class Discovery via Self-Supervised Learning
- 2025Towards Open-Vocabulary Industrial Defect Understanding with a Large-Scale Multimodal Dataset
- 2026Failure-Aware Refinement of Vision-Language Model for Lithography Defect Detection
- 2024Addressing Class Imbalance and Data Limitations in Advanced Node Semiconductor Defect Inspection: A Generative Approach for SEM Images
- 2026Improving Combined Detection and Classification of TEM Defects via Mask-Conditioned Latent Diffusion Augmentation
- 2026IoT-Enhanced CNN-Based Labelled Crack Detection for Additive Manufacturing Image Annotation in Industry 4.0
- 2024DDPM-MoCo: Advancing Industrial Surface Defect Generation and Detection with Generative and Contrastive Learning