Pediatric Otoscopy Video Screening with Shift Contrastive Anomaly Detection
Not on the map. Why?
Abstract (arXiv)
Ear related concerns and symptoms represents the leading indication for seeking pediatric healthcare attention. Despite the high incidence of such encounters, the diagnostic process of commonly encountered disease of the middle and external presents significant challenge. Much of this challenge stems from the lack of cost effective diagnostic testing, which necessitating the presence or absence of ear pathology to be determined clinically. Research has however demonstrated considerable variation among clinicians in their ability to accurately diagnose and consequently manage ear pathology. With recent advances in computer vision and machine learning, there is an increasing interest in helping clinicians to accurately diagnose middle and external ear pathology with computer-aided systems. It has been shown that AI has the capacity to analyse a single clinical image captured during examination of the ear canal and eardrum from which it can determine the likelihood of a pathognomonic pattern for a specific diagnosis being present. The capture of such an image can however be challenging especially to inexperienced clinicians. To help mitigate this technical challenge we have developed and tested a method using video sequences. We present a two stage method that first, identifies valid frames by detecting and extracting ear drum patches from the video sequence, and second, performs the proposed shift contrastive anomaly detection to flag the otoscopy video sequences as normal or abnormal. Our method achieves an AUROC of 88.0% on the patient-level and also outperforms the average of a group of 25 clinicians in a comparative study, which is the largest of such published to date. We conclude that the presented method achieves a promising first step towards automated analysis of otoscopy video.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 58 references that are in the map. First posted on arXiv 25 Oct 2021.
Builds on
25 of 58 references.
References · 25
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 531
- 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
- 2020A Unifying Review of Deep and Shallow Anomaly Detectioncited by 425
- 2019Deep Learning for Anomaly Detection: A Surveycited by 358
- 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
- 2019Revisiting Self-Supervised Visual Representation Learningcited by 251
13 more
- 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
- 2020Autoencoders for Unsupervised Anomaly Segmentation in Brain MR Images: A Comparative Studycited by 147
- 2020Learning and Evaluating Representations for Deep One-class Classificationcited by 133
- 2020Deep Learning for Medical Anomaly Detection -- A Surveycited by 127
- 2016Deep Structured Energy Based Models for Anomaly Detectioncited by 114
- 2021Mean-Shifted Contrastive Loss for Anomaly Detectioncited by 88
- 2018Context-encoding Variational Autoencoder for Unsupervised Anomaly Detectioncited by 64
- 2020MADGAN: unsupervised Medical Anomaly Detection GAN using multiple adjacent brain MRI slice reconstructioncited by 50
- 2020Detecting Outliers with Foreign Patch Interpolationcited by 44
- 2021Detecting Outliers with Poisson Image Interpolationcited by 44
- 2019Novelty Detection Via Blurringcited by 24
- 2020Anomaly Detection on X-Rays Using Self-Supervised Aggregation Learningcited by 9
- 2020Unsupervised Anomaly Detection for X-Ray Imagescited by 6
Built on by
Not cited yet.