Beyond Knowledge Silos: Task Fingerprinting for Democratization of Medical Imaging AI
Not on the map. Why?
Abstract (arXiv)
The field of medical imaging AI is currently undergoing rapid transformations, with methodical research increasingly translated into clinical practice. Despite these successes, research suffers from knowledge silos, hindering collaboration and progress: Existing knowledge is scattered across publications and many details remain unpublished, while privacy regulations restrict data sharing. In the spirit of democratizing of AI, we propose a framework for secure knowledge transfer in the field of medical image analysis. The key to our approach is dataset "fingerprints", structured representations of feature distributions, that enable quantification of task similarity. We tested our approach across 71 distinct tasks and 12 medical imaging modalities by transferring neural architectures, pretraining, augmentation policies, and multi-task learning. According to comprehensive analyses, our method outperforms traditional methods for identifying relevant knowledge and facilitates collaborative model training. Our framework fosters the democratization of AI in medical imaging and could become a valuable tool for promoting faster scientific advancement.
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 74 of its 125 references that are in the map. First posted on arXiv 11 Dec 2024.
Builds on
74 of 125 references.
References · 74
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,364
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,915
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,999
- 2019Searching for MobileNetV3cited by 1,990
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,628
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,419
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,322
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,306
- 2019A Comprehensive Survey on Transfer Learningcited by 1,157
- 2020Designing Network Design Spacescited by 956
38 more
- 2019Big Transfer (BiT): General Visual Representation Learningcited by 768
- 2018AutoAugment: Learning Augmentation Policies from Datacited by 730
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 633
- 2020The Future of Digital Health with Federated Learningcited by 630
- 2015Cyclical Learning Rates for Training Neural Networkscited by 627
- 2021The Medical Segmentation Decathloncited by 622
- 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 574
- 2018Albumentations: fast and flexible image augmentationscited by 558
- 2019Res2Net: A New Multi-scale Backbone Architecturecited by 468
- 2020ResNeSt: Split-Attention Networkscited by 445
- 2019Selective Kernel Networkscited by 403
- 2019AutoML: A Survey of the State-of-the-Artcited by 389
- 2019CSPNet: A New Backbone that can Enhance Learning Capability of CNNcited by 381
- 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 375
- 2019A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protectioncited by 374
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 372
- 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 368
- 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 367
- 2021ResNet strikes back: An improved training procedure in timmcited by 367
- 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 366
- 2020FLTrust: Byzantine-robust Federated Learning via Trust Bootstrappingcited by 339
- 2021The Intrinsic Dimension of Images and Its Impact on Learningcited by 312
- 2019Adversarial Examples Improve Image Recognitioncited by 284
- 2019CondConv: Conditionally Parameterized Convolutions for Efficient Inferencecited by 273
- 2024nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentationcited by 237
- 2019Billion-scale semi-supervised learning for image classificationcited by 232
- 2018Characterizing and Avoiding Negative Transfercited by 227
- 2021Efficiently Identifying Task Groupings for Multi-Task Learningcited by 219
- 2019High-Resolution Representations for Labeling Pixels and Regionscited by 211
- 2019Task2Vec: Task Embedding for Meta-Learningcited by 201
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 193
- 2022Metrics reloaded: Recommendations for image analysis validationcited by 192
- 2020LEEP: A New Measure to Evaluate Transferability of Learned Representationscited by 183
- 2021LogME: Practical Assessment of Pre-trained Models for Transfer Learningcited by 168
- 2019An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detectioncited by 163
- 2020Geometric Dataset Distances via Optimal Transportcited by 158
- 2020A Patient-Centric Dataset of Images and Metadata for Identifying Melanomas Using Clinical Contextcited by 146
- 2019Transferability and Hardness of Supervised Classification Taskscited by 125
50 most cited of 74 All 74 (JSON)
Built on by
Citing papers per year: 2025: 2.
2 papers.