mlsanityData to 7 Oct 2026

Probabilistic Feature Imputation and Uncertainty-Aware Multimodal Federated Aggregation

arXiv 2604.12970 ↗First posted 14 Apr 2026eess.IV cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Multimodal federated learning enables privacy-preserving collaborative model training across healthcare institutions. However, a fundamental challenge arises from modality heterogeneity: many clinical sites possess only a subset of modalities due to resource constraints or workflow variations. Existing approaches address this through feature imputation networks that synthesize missing modality representations, yet these methods produce point estimates without reliability measures, forcing downstream classifiers to treat all imputed features as equally trustworthy. In safety-critical medical applications, this limitation poses significant risks. We propose the Probabilistic Feature Imputation Network (P-FIN), which outputs calibrated uncertainty estimates alongside imputed features. This uncertainty is leveraged at two levels: (1) locally, through sigmoid gating that attenuates unreliable feature dimensions before classification, and (2) globally, through Fed-UQ-Avg, an aggregation strategy that prioritizes updates from clients with reliable imputation. Experiments on federated chest X-ray classification using CheXpert, NIH Open-I, and PadChest demonstrate consistent improvements over deterministic baselines, with +5.36% AUC gain in the most challenging configuration.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

25 of 35 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  5. 2017On Calibration of Modern Neural Networkscited by 4,860
  6. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  7. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  8. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  9. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  10. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  11. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
  12. 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 636
13 more
  1. 2020The Future of Digital Health with Federated Learningcited by 625
  2. 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
  3. 2018Stacked Cross Attention for Image-Text Matchingcited by 414
  4. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
  5. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
  6. 2023Multimodal Deep Learningcited by 257
  7. 2017Gated Multimodal Units for Information Fusioncited by 244
  8. 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 243
  9. 2018Exploring Uncertainty Measures in Deep Networks for Multiple Sclerosis Lesion Detection and Segmentationcited by 146
  10. 2022On the Pitfalls of Heteroscedastic Uncertainty Estimation with Probabilistic Neural Networkscited by 119
  11. 2019Assessing Reliability and Challenges of Uncertainty Estimations for Medical Image Segmentationcited by 75
  12. 2021Recalibration of Aleatoric and Epistemic Regression Uncertainty in Medical Imagingcited by 18
  13. 2025Multimodal Federated Learning With Missing Modalities through Feature Imputation Networkcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.