Label-Assemble: Leveraging Multiple Datasets with Partial Labels
Not on the map. Why?
Abstract (arXiv)
The success of deep learning relies heavily on large labeled datasets, but we often only have access to several small datasets associated with partial labels. To address this problem, we propose a new initiative, "Label-Assemble", that aims to unleash the full potential of partial labels from an assembly of public datasets. We discovered that learning from negative examples facilitates both computer-aided disease diagnosis and detection. This discovery will be particularly crucial in novel disease diagnosis, where positive examples are hard to collect, yet negative examples are relatively easier to assemble. For example, assembling existing labels from NIH ChestX-ray14 (available since 2017) significantly improves the accuracy of COVID-19 diagnosis from 96.3% to 99.3%. In addition to diagnosis, assembling labels can also improve disease detection, e.g., the detection of pancreatic ductal adenocarcinoma (PDAC) can greatly benefit from leveraging the labels of Cysts and PanNets (two other types of pancreatic abnormalities), increasing sensitivity from 52.1% to 84.0% while maintaining a high specificity of 98.0%.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 48 of its 78 references that are in the map. First posted on arXiv 25 Sep 2021.
Builds on
48 of 78 references.
References · 48
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
- 2021The Medical Segmentation Decathloncited by 620
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
36 more
- 2016Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learningcited by 441
- 2020Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learningcited by 297
- 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 282
- 2020COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest X-Ray Imagescited by 264
- 2014Learning with Pseudo-Ensemblescited by 241
- 2020Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networkscited by 227
- 2020MedMNIST Classification Decathlon: A Lightweight AutoML Benchmark for Medical Image Analysiscited by 206
- 2019The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: Results of the KiTS19 Challengecited by 188
- 2020Hierarchical Multi-Scale Attention for Semantic Segmentationcited by 183
- 2019The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomescited by 168
- 2020CheXclusion: Fairness gaps in deep chest X-ray classifierscited by 153
- 2020Unsupervised Learning of Dense Visual Representationscited by 147
- 2020DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasetscited by 94
- 2019Prior-aware Neural Network for Partially-Supervised Multi-Organ Segmentationcited by 88
- 2021XProtoNet: Diagnosis in Chest Radiography with Global and Local Explanationscited by 72
- 2020Multi-organ Segmentation over Partially Labeled Datasets with Multi-scale Feature Abstractioncited by 70
- 2018Comparison of Deep Learning Approaches for Multi-Label Chest X-Ray Classificationcited by 57
- 2020Interpreting Chest X-rays via CNNs that Exploit Hierarchical Disease Dependencies and Uncertainty Labelscited by 56
- 2017Thoracic Disease Identification and Localization with Limited Supervisioncited by 55
- 2020Learning from Multiple Datasets with Heterogeneous and Partial Labels for Universal Lesion Detection in CTcited by 42
- 2017Fast Image Processing with Fully-Convolutional Networkscited by 41
- 2017Learning to diagnose from scratch by exploiting dependencies among labelscited by 33
- 2018Learning to recognize Abnormalities in Chest X-Rays with Location-Aware Dense Networkscited by 33
- 2018Attention-Guided Curriculum Learning for Weakly Supervised Classification and Localization of Thoracic Diseases on Chest Radiographscited by 32
- 2021Cross-Dataset Collaborative Learning for Semantic Segmentation in Autonomous Drivingcited by 23
- 2018Weakly Supervised Medical Diagnosis and Localization from Multiple Resolutionscited by 22
- 2020Multi-label Thoracic Disease Image Classification with Cross-Attention Networkscited by 22
- 2020Taskology: Utilizing Task Relations at Scalecited by 19
- 2017Boosted Cascaded Convnets for Multilabel Classification of Thoracic Diseases in Chest Radiographscited by 18
- 2020Region Proposals for Saliency Map Refinement for Weakly-supervised Disease Localisation and Classificationcited by 15
- 2019GraphXNET- Chest X-Ray Classification Under Extreme Minimal Supervisioncited by 14
- 2020Improving Interpretability in Medical Imaging Diagnosis using Adversarial Trainingcited by 9
- 2021Incremental Learning for Multi-organ Segmentation with Partially Labeled Datasetscited by 9
- 2018Dynamic Routing on Deep Neural Network for Thoracic Disease Classification and Sensitive Area Localizationcited by 7
- 2020Universal Lesion Detection by Learning from Multiple Heterogeneously Labeled Datasetscited by 7
- 20193D Kidneys and Kidney Tumor Semantic Segmentation using Boundary-Aware Networkscited by 5
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 10; 2025: 3; 2026: 3.
20 papers.
Sort:
By area:
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2024MAISI: Medical AI for Synthetic Imagingcited by 86
- 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classificationcited by 65
- 2024Towards Generalizable Tumor Synthesiscited by 65
- 2023AbdomenAtlas-8K: Annotating 8,000 CT Volumes for Multi-Organ Segmentation in Three Weekscited by 52
- 2024SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuningcited by 32
- 2025PanTS: The Pancreatic Tumor Segmentation Datasetcited by 15
- 2025MedSegFactory: Text-Guided Generation of Medical Image-Mask Pairscited by 13
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
- 2024Analyzing Tumors by Synthesiscited by 11
- 2026Efficient Chest X-ray Representation Learning via Semantic-Partitioned Contrastive Learningcited by 10
- 2023Synthetic Data as Validationcited by 9
8 more
- 2024COLEP: Certifiably Robust Learning-Reasoning Conformal Prediction via Probabilistic Circuitscited by 9
- 2024Embracing Massive Medical Datacited by 9
- 2024Investigating the Quality of DermaMNIST and Fitzpatrick17k Dermatological Image Datasetscited by 7
- 2024Learning Low-Rank Feature for Thorax Disease Classificationcited by 4
- 2026RadThinking: A Dataset for Longitudinal Clinical Reasoning in Radiologycited by 4
- 2024Deep Mutual Learning among Partially Labeled Datasets for Multi-Organ Segmentationcited by 2
- 20263D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentationcited by 2
- 2024Labeled-to-Unlabeled Distribution Alignment for Partially-Supervised Multi-Organ Medical Image Segmentationcited by 1
- 2026RadThinking: A Dataset for Longitudinal Clinical Reasoning in Radiology11 May 2026
- 20263D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentation25 Mar 2026
- 2026Efficient Chest X-ray Representation Learning via Semantic-Partitioned Contrastive Learning7 Mar 2026
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Data16 Oct 2025
- 2025PanTS: The Pancreatic Tumor Segmentation Dataset2 Jul 2025
- 2025MedSegFactory: Text-Guided Generation of Medical Image-Mask Pairs9 Apr 2025
- 2024MAISI: Medical AI for Synthetic Imaging13 Sep 2024
- 2024Analyzing Tumors by Synthesis9 Sep 2024
- 2024Labeled-to-Unlabeled Distribution Alignment for Partially-Supervised Multi-Organ Medical Image Segmentation5 Sep 2024
- 2024Deep Mutual Learning among Partially Labeled Datasets for Multi-Organ Segmentation17 Jul 2024
- 2024SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning16 Jul 2024
- 2024Embracing Massive Medical Data5 Jul 2024
8 more
- 2024COLEP: Certifiably Robust Learning-Reasoning Conformal Prediction via Probabilistic Circuits17 Mar 2024
- 2024Towards Generalizable Tumor Synthesis29 Feb 2024
- 2024Learning Low-Rank Feature for Thorax Disease Classification14 Feb 2024
- 2024Investigating the Quality of DermaMNIST and Fitzpatrick17k Dermatological Image Datasets25 Jan 2024
- 2023Synthetic Data as Validation24 Oct 2023
- 2023AbdomenAtlas-8K: Annotating 8,000 CT Volumes for Multi-Organ Segmentation in Three Weeks16 May 2023
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection2 Jan 2023
- 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification23 Oct 2022
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classificationcited by 65
- 2024Towards Generalizable Tumor Synthesiscited by 65
- 2023AbdomenAtlas-8K: Annotating 8,000 CT Volumes for Multi-Organ Segmentation in Three Weekscited by 52
- 2024SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuningcited by 32
- 2025PanTS: The Pancreatic Tumor Segmentation Datasetcited by 15
- 2025MedSegFactory: Text-Guided Generation of Medical Image-Mask Pairscited by 13
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Datacited by 13
- 2024Analyzing Tumors by Synthesiscited by 11
- 2026Efficient Chest X-ray Representation Learning via Semantic-Partitioned Contrastive Learningcited by 10
- 2023Synthetic Data as Validationcited by 9
- 2024COLEP: Certifiably Robust Learning-Reasoning Conformal Prediction via Probabilistic Circuitscited by 9
12 most cited of 18 All 18 (JSON)
- 2026RadThinking: A Dataset for Longitudinal Clinical Reasoning in Radiology11 May 2026
- 2026Efficient Chest X-ray Representation Learning via Semantic-Partitioned Contrastive Learning7 Mar 2026
- 2025Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Data16 Oct 2025
- 2025PanTS: The Pancreatic Tumor Segmentation Dataset2 Jul 2025
- 2025MedSegFactory: Text-Guided Generation of Medical Image-Mask Pairs9 Apr 2025
- 2024Analyzing Tumors by Synthesis9 Sep 2024
- 2024Labeled-to-Unlabeled Distribution Alignment for Partially-Supervised Multi-Organ Medical Image Segmentation5 Sep 2024
- 2024Deep Mutual Learning among Partially Labeled Datasets for Multi-Organ Segmentation17 Jul 2024
- 2024SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning16 Jul 2024
- 2024Embracing Massive Medical Data5 Jul 2024
- 2024COLEP: Certifiably Robust Learning-Reasoning Conformal Prediction via Probabilistic Circuits17 Mar 2024
- 2024Towards Generalizable Tumor Synthesis29 Feb 2024
12 newest of 18 All 18 (JSON)