Supervised Contrastive Learning to Classify Paranasal Anomalies in the Maxillary Sinus
Not on the map. Why?
Abstract (arXiv)
Using deep learning techniques, anomalies in the paranasal sinus system can be detected automatically in MRI images and can be further analyzed and classified based on their volume, shape and other parameters like local contrast. However due to limited training data, traditional supervised learning methods often fail to generalize. Existing deep learning methods in paranasal anomaly classification have been used to diagnose at most one anomaly. In our work, we consider three anomalies. Specifically, we employ a 3D CNN to separate maxillary sinus volumes without anomalies from maxillary sinus volumes with anomalies. To learn robust representations from a small labelled dataset, we propose a novel learning paradigm that combines contrastive loss and cross-entropy loss. Particularly, we use a supervised contrastive loss that encourages embeddings of maxillary sinus volumes with and without anomaly to form two distinct clusters while the cross-entropy loss encourages the 3D CNN to maintain its discriminative ability. We report that optimising with both losses is advantageous over optimising with only one loss. We also find that our training strategy leads to label efficiency. With our method, a 3D CNN classifier achieves an AUROC of 0.85 while a 3D CNN classifier optimised with cross-entropy loss achieves an AUROC of 0.66.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 5 of its 21 references that are in the map. First posted on arXiv 5 Sep 2022.
Builds on
5 of 21 references.
References · 5
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2020Supervised Contrastive Learningcited by 2,803
- 2017Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognitioncited by 178
Built on by
Citing papers per year: 2023: 3; 2024: 1.
4 papers.
- 2023Towards multi-modal anatomical landmark detection for ultrasound-guided brain tumor resection with contrastive learningcited by 4
- 2023Multiple Instance Ensembling For Paranasal Anomaly Classification In The Maxillary Sinuscited by 1
- 2023SCOL: Supervised Contrastive Ordinal Loss for Abdominal Aortic Calcification Scoring on Vertebral Fracture Assessment Scanscited by 1
- 2024Self-supervised learning for classifying paranasal anomalies in the maxillary sinuscited by 0
- 2024Self-supervised learning for classifying paranasal anomalies in the maxillary sinus29 Apr 2024
- 2023Towards multi-modal anatomical landmark detection for ultrasound-guided brain tumor resection with contrastive learning26 Jul 2023
- 2023SCOL: Supervised Contrastive Ordinal Loss for Abdominal Aortic Calcification Scoring on Vertebral Fracture Assessment Scans22 Jul 2023
- 2023Multiple Instance Ensembling For Paranasal Anomaly Classification In The Maxillary Sinus31 Mar 2023