Efficient Pretraining Model based on Multi-Scale Local Visual Field Feature Reconstruction for PCB CT Image Element Segmentation
Not on the map. Why?
Abstract (arXiv)
Element segmentation is a key step in nondestructive testing of Printed Circuit Boards (PCB) based on Computed Tomography (CT) technology. In recent years, the rapid development of self-supervised pretraining technology can obtain general image features without labeled samples, and then use a small amount of labeled samples to solve downstream tasks, which has a good potential in PCB element segmentation. At present, Masked Image Modeling (MIM) pretraining model has been initially applied in PCB CT image element segmentation. However, due to the small and regular size of PCB elements such as vias, wires, and pads, the global visual field has redundancy for a single element reconstruction, which may damage the performance of the model. Based on this issue, we propose an efficient pretraining model based on multi-scale local visual field feature reconstruction for PCB CT image element segmentation (EMLR-seg). In this model, the teacher-guided MIM pretraining model is introduced into PCB CT image element segmentation for the first time, and a multi-scale local visual field extraction (MVE) module is proposed to reduce redundancy by focusing on local visual fields. At the same time, a simple 4-Transformer-blocks decoder is used. Experiments show that EMLR-seg can achieve 88.6% mIoU on the PCB CT image dataset we proposed, which exceeds 1.2% by the baseline model, and the training time is reduced by 29.6 hours, a reduction of 17.4% under the same experimental condition, which reflects the advantage of EMLR-seg in terms of performance and efficiency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 34 references that are in the map. First posted on arXiv 9 May 2024.
Builds on
26 of 34 references.
References · 26
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2023Segment Anythingcited by 8,158
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
14 more
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 573
- 2021PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformerscited by 204
- 2022MVP: Multimodality-guided Visual Pre-trainingcited by 92
- 2022MILAN: Masked Image Pretraining on Language Assisted Representationcited by 69
- 2022Bootstrapped Masked Autoencoders for Vision BERT Pretrainingcited by 60
- 2022Exploring Target Representations for Masked Autoencoderscited by 46
- 2022Masked Image Modeling with Denoising Contrastcited by 45
- 2020Graph-FCN for image semantic segmentationcited by 13
Built on by
Not cited yet.