Event Fields: Learning Latent Event Structure for Waveform Foundation Models
Not on the map. Why?
Abstract (arXiv)
We propose a new class of waveform foundation models that departs from conventional sequence based representations by modeling physiological time series as realizations of latent event processes. Rather than treating signals as collections of local tokens or patches, our approach assumes that clinically meaningful structure arises from temporally extended, interacting events whose boundaries and dynamics are not directly observed. To capture this structure, we introduce a self supervised learning framework that enforces consistency across stochastic segmentations and time frequency projections of the same waveform, encouraging representations that are invariant to signal level perturbations while preserving event level organization. The resulting model combines a segmentation aware encoder with a latent interaction operator that captures dependencies among inferred events, and naturally extends to multimodal settings by aligning modalities through shared event representations. Across a range of physiological benchmarks, including arrhythmia classification, hemodynamic prediction, and waveform retrieval, the proposed method improves performance, robustness, and label efficiency relative to strong sequence based baselines. These results suggest that shifting from signal centric to event centric representations provides a more appropriate inductive bias for modeling physiological dynamics and offers a complementary path to scaling foundation models in healthcare.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 56 of its 81 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
56 of 81 references.
References · 56
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Segment Anythingcited by 8,158
- 2023Visual Instruction Tuningcited by 7,792
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
38 more
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2023A Survey of Large Language Modelscited by 2,537
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2019Contrastive Representation Distillationcited by 734
- 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 717
- 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 430
- 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
- 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
- 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 234
- 2019Cross Attention Network for Few-shot Classificationcited by 218
- 2022UNETR++: Delving into Efficient and Accurate 3D Medical Image Segmentationcited by 112
- 2023Large-scale Training of Foundation Models for Wearable Biosignalscited by 89
- 2020Language Models Are An Effective Patient Representation Learning Technique For Electronic Health Record Datacited by 85
- 2024Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directionscited by 77
- 2023MOTOR: A Time-To-Event Foundation Model For Structured Medical Recordscited by 75
- 2025MedHELM: Holistic Evaluation of Large Language Models for Medical Taskscited by 60
- 2024Context Clues: Evaluating Long Context Models for Clinical Prediction Tasks on EHRscited by 39
- 2024EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Recordscited by 31
- 2025Clinical ModernBERT: An efficient and long context encoder for biomedical textcited by 26
- 2023Frequency-Aware Masked Autoencoders for Multimodal Pretraining on Biosignalscited by 22
- 2024Emergency Department Decision Support using Clinical Pseudo-notescited by 22
- 2024Can Large Language Models abstract Medical Coded Language?cited by 20
- 2024CORE-BEHRT: A Carefully Optimized and Rigorously Evaluated BEHRTcited by 20
- 2025GENERator: A Long-Context Generative Genomic Foundation Modelcited by 20
- 2024E3D-GPT: Enhanced 3D Visual Foundation for Medical Vision-Language Modelcited by 19
- 2025HiMAE: Hierarchical Masked Autoencoders Discover Resolution-Specific Structure in Wearable Time Seriescited by 19
- 2024Text Serialization and Their Relationship with the Conventional Paradigms of Tabular Machine Learningcited by 17
- 2023E2ENet: Dynamic Sparse Feature Fusion for Accurate and Efficient 3D Medical Image Segmentationcited by 16
- 2025A Case Study Exploring the Current Landscape of Synthetic Medical Record Generation with Commercial LLMscited by 13
- 2025ChronoFormer: Time-Aware Transformer Architectures for Structured Clinical Event Modelingcited by 11
- 2025Foundation models for electronic health records: representation dynamics and transferabilitycited by 11
- 2024GenBench: A Benchmarking Suite for Systematic Evaluation of Genomic Foundation Modelscited by 10
- 2024Contrastive Learning of Preferences with a Contextual InfoNCE Losscited by 9
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.