MorphologyFM: A Foundation Model for Morphology-Aware Representation Learning from ECG and Pulse Oximetry Waveforms
Not on the map. Why?
Abstract (arXiv)
Foundation models have recently emerged as a powerful paradigm for learning transferable representations from large scale biomedical data, yet existing approaches for physiological waveforms primarily optimize reconstruction or forecasting objectives that do not explicitly preserve clinically meaningful waveform morphology. Electrocardiograms (ECGs) and pulse oximetry (SpO2) waveforms encode rich cardiovascular and hemodynamic information through their morphological structure. In this work, we introduce MorphologyFM, a multimodal foundation model pretrained on paired ECG and SpO2 waveforms from the MIMIC critical care database using a morphology aware self supervised learning objective. MorphologyFM combines morphology guided masking, cross modal representation learning, and contrastive latent alignment to learn representations that capture clinically relevant physiological structure without requiring manual annotations. We evaluate MorphologyFM across multiple downstream prediction tasks, including arrhythmia classification, hypoxemia prediction, mortality prediction, and length of stay estimation, demonstrating consistent improvements over representative self supervised learning methods, including Masked Autoencoders (MAE), contrastive learning, Barlow Twins, and Joint Embedding Predictive Architectures (JEPA). Furthermore, we show that jointly modeling ECG and SpO2 waveforms produces more transferable representations than single modality pretraining. Our results establish waveform morphology as a powerful inductive bias for self supervised physiological representation learning and introduce MorphologyFM as a general purpose foundation model for continuous physiological monitoring.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 101 references that are in the map. First posted on arXiv 3 Jul 2026.
Builds on
59 of 101 references.
References · 59
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2023A Survey of Large Language Modelscited by 2,576
38 more
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2019Contrastive Representation Distillationcited by 748
- 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 718
- 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 431
- 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
- 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
- 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 239
- 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
- 2019Cross Attention Network for Few-shot Classificationcited by 219
- 2022UNETR++: Delving into Efficient and Accurate 3D Medical Image Segmentationcited by 112
- 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 105
- 2023Large-scale Training of Foundation Models for Wearable Biosignalscited by 95
- 2020Language Models Are An Effective Patient Representation Learning Technique For Electronic Health Record Datacited by 87
- 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 78
- 2024Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directionscited by 77
- 2024AbdomenAtlas: A Large-Scale, Detailed-Annotated, & Multi-Center Dataset for Efficient Transfer Learning and Open Algorithmic Benchmarkingcited by 65
- 2024Context Clues: Evaluating Long Context Models for Clinical Prediction Tasks on EHRscited by 39
- 2025Seq vs Seq: An Open Suite of Paired Encoders and Decoderscited by 38
- 2023MIS-FM: 3D Medical Image Segmentation using Foundation Models Pretrained on a Large-Scale Unannotated Datasetcited by 26
- 2025Clinical ModernBERT: An efficient and long context encoder for biomedical textcited by 26
- 2024Can Large Language Models abstract Medical Coded Language?cited by 20
- 2024CORE-BEHRT: A Carefully Optimized and Rigorously Evaluated BEHRTcited by 20
- 2024E3D-GPT: Enhanced 3D Visual Foundation for Medical Vision-Language Modelcited by 19
- 2025HiMAE: Hierarchical Masked Autoencoders Discover Resolution-Specific Structure in Wearable Time Seriescited by 19
- 2025EHR-R1: A Reasoning-Enhanced Foundational Language Model for Electronic Health Record Analysiscited by 18
- 2023E2ENet: Dynamic Sparse Feature Fusion for Accurate and Efficient 3D Medical Image Segmentationcited by 16
- 2025A Case Study Exploring the Current Landscape of Synthetic Medical Record Generation with Commercial LLMscited by 13
- 2025Raptor: Scalable Train-Free Embeddings for 3D Medical Volumes Leveraging Pretrained 2D Foundation Modelscited by 13
- 2025ChronoFormer: Time-Aware Transformer Architectures for Structured Clinical Event Modelingcited by 12
- 2025Foundation models for electronic health records: representation dynamics and transferabilitycited by 11
- 2024Contrastive Learning of Preferences with a Contextual InfoNCE Losscited by 9
- 2026JEPA-DNA: Grounding Genomic Foundation Models through Joint-Embedding Predictive Architecturescited by 9
- 2026GlucoFM: A Dual-Stream Foundation Model for Continuous Glucose Monitoringcited by 7
- 2025Beyond the Failures: Rethinking Foundation Models in Pathologycited by 6
- 2026One Loss to Rule Them All: Marked Time-to-Event for Structured EHR Foundation Modelscited by 5
- 2026Physiology-Aware Masked Cross-Modal Reconstruction for Biosignal Representation Learningcited by 5
- 2025CP-Env: Evaluating Large Language Models on Clinical Pathways in a Controllable Hospital Environmentcited by 4
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.