mlsanityData to 7 Oct 2026

Investigating Shift Equivalence of Convolutional Neural Networks in Industrial Defect Segmentation

arXiv 2309.16902 ↗First posted 29 Sep 2023cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

In industrial defect segmentation tasks, while pixel accuracy and Intersection over Union (IoU) are commonly employed metrics to assess segmentation performance, the output consistency (also referred to equivalence) of the model is often overlooked. Even a small shift in the input image can yield significant fluctuations in the segmentation results. Existing methodologies primarily focus on data augmentation or anti-aliasing to enhance the network's robustness against translational transformations, but their shift equivalence performs poorly on the test set or is susceptible to nonlinear activation functions. Additionally, the variations in boundaries resulting from the translation of input images are consistently disregarded, thus imposing further limitations on the shift equivalence. In response to this particular challenge, a novel pair of down/upsampling layers called component attention polyphase sampling (CAPS) is proposed as a replacement for the conventional sampling layers in CNNs. To mitigate the effect of image boundary variations on the equivalence, an adaptive windowing module is designed in CAPS to adaptively filter out the border pixels of the image. Furthermore, a component attention module is proposed to fuse all downsampled features to improve the segmentation performance. The experimental results on the micro surface defect (MSD) dataset and four real-world industrial defect datasets demonstrate that the proposed method exhibits higher equivalence and segmentation performance compared to other state-of-the-art methods.Our code will be available at https://github.com/xiaozhen228/CAPS.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 23 of its 47 references that are in the map. First posted on arXiv 29 Sep 2023.

Builds on

23 of 47 references.

References · 23

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2023Segment Anythingcited by 8,158
  4. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  5. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  6. 2016Pyramid Scene Parsing Networkcited by 2,472
  7. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  8. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
  9. 2017Deformable Convolutional Networkscited by 1,481
  10. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
  11. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 572
  12. 2019Making Convolutional Networks Shift-Invariant Againcited by 390
11 more
  1. 2014Understanding image representations by measuring their equivariance and equivalencecited by 240
  2. 2018Why do deep convolutional networks generalize so poorly to small image transformations?cited by 198
  3. 2018Multi-level Wavelet-CNN for Image Restorationcited by 184
  4. 2018DUNet: A deformable network for retinal vessel segmentationcited by 89
  5. 2020Delving Deeper into Anti-aliasing in ConvNetscited by 60
  6. 2020Truly shift-invariant convolutional neural networkscited by 53
  7. 2023SAM Fails to Segment Anything? -- SAM-Adapter: Adapting SAM in Underperformed Scenes: Camouflage, Shadow, Medical Image Segmentation, and Morecited by 53
  8. 2022MIAD: A Maintenance Inspection Dataset for Unsupervised Anomaly Detectioncited by 19
  9. 2022Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networkscited by 18
  10. 2020Print Defect Mapping with Semantic Segmentationcited by 3
  11. 2021Investigating Shift-Variance of Convolutional Neural Networks in Ultrasound Image Segmentationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 3.

6 papers.