mlsanityData to 13 Oct 2026

Beyond Knowledge Silos: Task Fingerprinting for Democratization of Medical Imaging AI

arXiv 2412.08763 ↗First posted 11 Dec 2024cs.CV cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

The field of medical imaging AI is currently undergoing rapid transformations, with methodical research increasingly translated into clinical practice. Despite these successes, research suffers from knowledge silos, hindering collaboration and progress: Existing knowledge is scattered across publications and many details remain unpublished, while privacy regulations restrict data sharing. In the spirit of democratizing of AI, we propose a framework for secure knowledge transfer in the field of medical image analysis. The key to our approach is dataset "fingerprints", structured representations of feature distributions, that enable quantification of task similarity. We tested our approach across 71 distinct tasks and 12 medical imaging modalities by transferring neural architectures, pretraining, augmentation policies, and multi-task learning. According to comprehensive analyses, our method outperforms traditional methods for identifying relevant knowledge and facilitates collaborative model training. Our framework fosters the democratization of AI in medical imaging and could become a valuable tool for promoting faster scientific advancement.

Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 74 of its 125 references that are in the map. First posted on arXiv 11 Dec 2024.

Builds on

74 of 125 references.

References · 74

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,364
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,915
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 3,999
  6. 2019Searching for MobileNetV3cited by 1,990
  7. 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,628
  8. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,419
  9. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,322
  10. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,306
  11. 2019A Comprehensive Survey on Transfer Learningcited by 1,157
  12. 2020Designing Network Design Spacescited by 956
38 more
  1. 2019Big Transfer (BiT): General Visual Representation Learningcited by 768
  2. 2018AutoAugment: Learning Augmentation Policies from Datacited by 730
  3. 2018Taskonomy: Disentangling Task Transfer Learningcited by 633
  4. 2020The Future of Digital Health with Federated Learningcited by 630
  5. 2015Cyclical Learning Rates for Training Neural Networkscited by 627
  6. 2021The Medical Segmentation Decathloncited by 622
  7. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 574
  8. 2018Albumentations: fast and flexible image augmentationscited by 558
  9. 2019Res2Net: A New Multi-scale Backbone Architecturecited by 468
  10. 2020ResNeSt: Split-Attention Networkscited by 445
  11. 2019Selective Kernel Networkscited by 403
  12. 2019AutoML: A Survey of the State-of-the-Artcited by 389
  13. 2019CSPNet: A New Backbone that can Enhance Learning Capability of CNNcited by 381
  14. 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 375
  15. 2019A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protectioncited by 374
  16. 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 372
  17. 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 368
  18. 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 367
  19. 2021ResNet strikes back: An improved training procedure in timmcited by 367
  20. 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 366
  21. 2020FLTrust: Byzantine-robust Federated Learning via Trust Bootstrappingcited by 339
  22. 2021The Intrinsic Dimension of Images and Its Impact on Learningcited by 312
  23. 2019Adversarial Examples Improve Image Recognitioncited by 284
  24. 2019CondConv: Conditionally Parameterized Convolutions for Efficient Inferencecited by 273
  25. 2024nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentationcited by 237
  26. 2019Billion-scale semi-supervised learning for image classificationcited by 232
  27. 2018Characterizing and Avoiding Negative Transfercited by 227
  28. 2021Efficiently Identifying Task Groupings for Multi-Task Learningcited by 219
  29. 2019High-Resolution Representations for Labeling Pixels and Regionscited by 211
  30. 2019Task2Vec: Task Embedding for Meta-Learningcited by 201
  31. 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 193
  32. 2022Metrics reloaded: Recommendations for image analysis validationcited by 192
  33. 2020LEEP: A New Measure to Evaluate Transferability of Learned Representationscited by 183
  34. 2021LogME: Practical Assessment of Pre-trained Models for Transfer Learningcited by 168
  35. 2019An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detectioncited by 163
  36. 2020Geometric Dataset Distances via Optimal Transportcited by 158
  37. 2020A Patient-Centric Dataset of Images and Metadata for Identifying Melanomas Using Clinical Contextcited by 146
  38. 2019Transferability and Hardness of Supervised Classification Taskscited by 125

50 most cited of 74 All 74 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.