Towards Whole-Study Screening for Congenital Heart Disease in Fetal Ultrasound Using Multiple Instance Learning
Not on the map. Why?
Abstract (arXiv)
Congenital heart disease (CHD) is the most common birth defect, yet a large fraction of cases remain undetected on prenatal ultrasound, in part because current artificial-intelligence methods assume that the key diagnostic frames have already been isolated from a study, by a clinician or by a view classifier. We remove that assumption and address CHD screening directly at the level of the whole ultrasound study. We propose a two-stage framework that first learns transferable frame representations by self-supervised masked-autoencoder pre-training on unlabeled fetal ultrasound, then identifies cardiac frames with a disease-robust module and aggregates them with a transformer-based multiple instance learning (MIL) model that produces a case-level diagnosis from study-level labels alone. The model further returns its highest-scoring frames for clinician review, and a hierarchical head separates critical from non-critical CHD. On the internal test set of our multi-source development cohort (FUSE), the proposed cardiac-gated MIL model reaches an area under the curve (AUC) of 0.985 with a specificity of 0.990, outperforming the reproduced NATMED ensemble (AUC 0.861, specificity 0.600) and the FetalCLIP foundation model (AUC 0.867, specificity 0.710). On an independent external cohort, all models initially perform near chance, but label-free CORAL adaptation raises the proposed model from an AUC of 0.513 to 0.944, whereas whole-study and view-dependent baselines do not recover. These results indicate that whole-study MIL with disease-robust cardiac-frame identification is an accurate and deployable route to prenatal CHD screening.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 68 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
29 of 68 references.
References · 29
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 555
17 more
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 478
- 2016Revisiting Multiple Instance Neural Networkscited by 119
- 2016SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasoundcited by 71
- 2022Additive MIL: Intrinsically Interpretable Multiple Instance Learning for Pathologycited by 58
- 2022DGMIL: Distribution Guided Multiple Instance Learning for Whole Slide Image Classificationcited by 40
- 2022A Review on Deep-Learning Algorithms for Fetal Ultrasound-Image Analysiscited by 29
- 2025FetalCLIP: A Visual-Language Foundation Model for Fetal Ultrasound Image Analysiscited by 24
- 2021A novel multiple instance learning framework for COVID-19 severity assessment via data augmentation and self-supervised learningcited by 19
- 2024Shortcut Learning in Medical Image Segmentationcited by 16
- 2022Generalisability of fetal ultrasound deep learning models to low-resource imaging settings in five African countriescited by 15
- 2024Ordinal Multiple-instance Learning for Ulcerative Colitis Severity Estimation with Selective Aggregated Transformercited by 7
- 2020Automated Detection of Congenital Heart Disease in Fetal Ultrasound Screeningcited by 5
- 2024Semi-Supervised Multimodal Multi-Instance Learning for Aortic Stenosis Diagnosiscited by 4
- 2025Medical-Knowledge Driven Multiple Instance Learning for Classifying Severe Abdominal Anomalies on Prenatal Ultrasoundcited by 4
- 2025A multi-centre, multi-device benchmark dataset for landmark-based comprehensive fetal biometrycited by 3
- 2025CARDIUM: Congenital Anomaly Recognition with Diagnostic Images and Unified Medical recordscited by 2
- 2026QG-MIL: A Gated Transformer Aggregator for Domain-Agnostic Multiple Instance Learning in Medical Imagingcited by 1
Built on by
Not cited yet.