PaCX-MAE: Physiology-Augmented Chest X-Ray Masked Autoencoder
Not on the map. Why?
Abstract (arXiv)
Clinical diagnosis often requires combining imaging with physiological measurements, yet deployed models typically operate on unimodal data. We present PaCX-MAE, a cross-modal distillation framework that injects physiological priors into chest X-ray (CXR) encoders while remaining strictly unimodal at inference. PaCX-MAE augments in-domain masked autoencoding with a dual contrastive-predictive objective, aligning CXR representations with paired ECG and laboratory embeddings. Extensive evaluation across nine benchmarks demonstrates consistent improvements over domain-specific MAE, particularly on physiology-dependent tasks (e.g., +2.7 AUROC on MedMod; +6.5 F1 on VinDr). The method proves highly label-efficient in the 1% regime and preserves anatomical fidelity, achieving parity with MAE on segmentation tasks. Zero-shot and attention analyses confirm that PaCX-MAE successfully learns to attend to physiological indicators, such as the cardiac silhouette, absent in standard visual pretraining.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 34 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
19 of 34 references.
References · 19
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
- 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 641
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
- 2021Big Self-Supervised Models Advance Medical Image Classificationcited by 320
- 2015Unifying distillation and privileged informationcited by 233
- 2020Can AI help in screening Viral and COVID-19 pneumonia?cited by 200
- 2015Cross Modal Distillation for Supervision Transfercited by 175
- 2020Unpaired Multi-modal Segmentation via Knowledge Distillationcited by 81
- 2022Self Pre-training with Masked Autoencoders for Medical Image Classification and Segmentationcited by 69
- 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classificationcited by 65
7 more
- 2022OSegNet: Operational Segmentation Network for COVID-19 Detection using Chest X-ray Imagescited by 48
- 2023Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modalitycited by 45
- 2020COVID-19 Infection Map Generation and Detection from Chest X-Ray Imagescited by 28
- 2024Contrasting with Symile: Simple Model-Agnostic Representation Learning for Unlimited Modalitiescited by 24
- 2020Convolutional Sparse Support Estimator Based Covid-19 Recognition from X-ray Imagescited by 13
- 2020Advance Warning Methodologies for COVID-19 using Chest X-Ray Imagescited by 9
- 2021Reliable COVID-19 Detection Using Chest X-ray Imagescited by 5
Built on by
Not cited yet.