mlsanityData to 14 Oct 2026

Transferable Low-Rank Convolutional Bases for Onboarding Unseen Medical Imaging Modalities

arXiv 2607.16888 ↗First posted 18 Jul 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Deploying a medical imaging model that must later accommodate a modality it has never seen is a recurring practical problem: retraining the shared representation is expensive and destroys performance on the modalities already in service. We study this onboarding problem under a strict leave-one-domain-out protocol, in which a convolutional backbone is pre-trained on source modalities (Kidney CT and Brain MRI), frozen permanently, and then required to accommodate an unseen modality (Chest X-ray). Under this protocol we establish three findings. First, decision-layer parameter-efficient fine-tuning is insufficient when the backbone has never observed the target modality: a linear probe and fully-connected LoRA both fall well short, whereas convolutional LoRA recovers most of the achievable accuracy, showing that adaptation must reach the convolutional features. Second, and centrally, the low-rank convolutional basis learned on the source modalities transfers: freezing that basis and training only its up-projections onboards the unseen modality using just 0.78% of full fine-tuning's parameters, at an accuracy 6.11 percentage points above a random basis of identical size, while an equivalent decision-layer basis exhibits no reliable transfer. Third, adapter-based onboarding leaves source-modality accuracy exactly unchanged (Delta = 0.00 pp), whereas full fine-tuning reaches the highest target accuracy only by catastrophically degrading the source modalities. A Mahalanobis score on frozen backbone features detects the unseen modality with high sensitivity at a strict source-retention threshold, providing a practical trigger for when onboarding is required. All results are reported over three seeds with paired bootstrap confidence intervals.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 18 Jul 2026.

Builds on

20 of 34 references.

References · 20

  1. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  3. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  4. 2016Learning without Forgettingcited by 2,496
  5. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  6. 2016Progressive Neural Networkscited by 1,361
  7. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
  8. 2020Energy-based Out-of-distribution Detectioncited by 1,299
  9. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 898
  10. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
  11. 2023LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Compositioncited by 364
  12. 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 357
8 more
  1. 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 352
  2. 2023VeRA: Vector-based Random Matrix Adaptationcited by 300
  3. 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
  4. 2024Mixture of LoRA Expertscited by 181
  5. 2023When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applicationscited by 111
  6. 2023Tied-Lora: Enhancing parameter efficiency of LoRA with weight tyingcited by 65
  7. 2023Parameter-Efficient Fine-Tuning for Medical Image Analysis: The Missed Opportunitycited by 56
  8. 2025TT-LoRA MoE: Unifying Parameter-Efficient Fine-Tuning and Sparse Mixture-of-Expertscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026JDCNet: Confidence-Gated Privileged-Modality Distillation for Cost-Preserving X-ray Inference
  2. 2026K-MaT: Knowledge-Anchored Manifold Transport for Cross-Modal Prompt Learning in Medical Imaging
  3. 2025WeCKD: Weakly-supervised Chained Distillation Network for Efficient Multimodal Medical Imaging
  4. 2026Model Merging for Medical LVLMs: A Benchmark and a Winner-Take-All Approach
  5. 2026Do Medical Vision Models Reason About Anatomy? Probing the Spatial Inductive Biases of Learned Visual Representations
  6. 2026Pan-FM: A Pan-Organ Foundation Model with Saliency-Guided Masking for Missing Robustness
  7. 2025Med-K2N: Flexible K-to-N Modality Translation for Medical Image Synthesis
  8. 2025T3: Test-Time Model Merging in VLMs for Zero-Shot Medical Imaging Analysis