# Active learning using weakly supervised signals for quality inspection

arXiv: https://arxiv.org/abs/2104.02973 · HTML: https://mlsanity.com/paper/2104.02973/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 21 of its 28 references that are in the map.
- First posted on arXiv 7 Apr 2021.

## Builds on (most cited first, 21 of 21)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization](https://mlsanity.com/paper/1610.02391/) (2016)
- [You Only Look Once: Unified, Real-Time Object Detection](https://mlsanity.com/paper/1506.02640/) (2015)
- [DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs](https://mlsanity.com/paper/1606.00915/) (2016)
- [SSD: Single Shot MultiBox Detector](https://mlsanity.com/paper/1512.02325/) (2015)
- [Domain-Adversarial Training of Neural Networks](https://mlsanity.com/paper/1505.07818/) (2015)
- [CyCADA: Cycle-Consistent Adversarial Domain Adaptation](https://mlsanity.com/paper/1711.03213/) (2017)
- [Revisiting Unreasonable Effectiveness of Data in Deep Learning Era](https://mlsanity.com/paper/1707.02968/) (2017)
- [Deep Bayesian Active Learning with Image Data](https://mlsanity.com/paper/1703.02910/) (2017)
- [ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentation](https://mlsanity.com/paper/1811.12833/) (2018)
- [FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptation](https://mlsanity.com/paper/1612.02649/) (2016)
- [Cost-Effective Active Learning for Deep Image Classification](https://mlsanity.com/paper/1701.03551/) (2017)
- [Suggestive Annotation: A Deep Active Learning Framework for Biomedical Image Segmentation](https://mlsanity.com/paper/1706.04737/) (2017)
- [Unsupervised Domain Adaptation in Semantic Segmentation: a Review](https://mlsanity.com/paper/2005.10876/) (2020)
- [DeepCut: Object Segmentation from Bounding Box Annotations using Convolutional Neural Networks](https://mlsanity.com/paper/1605.07866/) (2016)
- [Localization-Aware Active Learning for Object Detection](https://mlsanity.com/paper/1801.05124/) (2018)
- [Alleviating Semantic-level Shift: A Semi-supervised Domain Adaptation Method for Semantic Segmentation](https://mlsanity.com/paper/2004.00794/) (2020)
- [Unsupervised Hard Example Mining from Videos for Improved Object Detection](https://mlsanity.com/paper/1808.04285/) (2018)
- [Soft Sampling for Robust Object Detection](https://mlsanity.com/paper/1806.06986/) (2018)
- [OMNIA Faster R-CNN: Detection in the wild through dataset merging and soft distillation](https://mlsanity.com/paper/1812.02611/) (2018)
- [Loss Rank Mining: A General Hard Example Mining Method for Real-time Detectors](https://mlsanity.com/paper/1804.04606/) (2018)

## Built on by (most cited first, 4 of 4)

- [Data refinement for fully unsupervised visual inspection using pre-trained networks](https://mlsanity.com/paper/2202.12759/) (2022)
- [Active Learning and Novel Model Calibration Measurements for Automated Visual Inspection in Manufacturing](https://mlsanity.com/paper/2209.05486/) (2022)
- [Data augmentation and pre-trained networks for extremely low data regimes unsupervised visual inspection](https://mlsanity.com/paper/2106.01277/) (2021)
- [Active Learning for Automated Visual Inspection of Manufactured Products](https://mlsanity.com/paper/2109.02469/) (2021)

## Abstract (arXiv)

Because manufacturing processes evolve fast, and since production visual aspect can vary significantly on a daily basis, the ability to rapidly update machine vision based inspection systems is paramount. Unfortunately, supervised learning of convolutional neural networks requires a significant amount of annotated images for being able to learn effectively from new data. Acknowledging the abundance of continuously generated images coming from the production line and the cost of their annotation, we demonstrate it is possible to prioritize and accelerate the annotation process. In this work, we develop a methodology for learning actively, from rapidly mined, weakly (i.e. partially) annotated data, enabling a fast, direct feedback from the operators on the production line and tackling a big machine vision weakness: false positives. We also consider the problem of covariate shift, which arises inevitably due to changing conditions during data acquisition. In that regard, we show domain-adversarial training to be an efficient way to address this issue.
