mlsanityData to 7 Oct 2026

Event Fields: Learning Latent Event Structure for Waveform Foundation Models

arXiv 2605.08685 ↗First posted 9 May 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose a new class of waveform foundation models that departs from conventional sequence based representations by modeling physiological time series as realizations of latent event processes. Rather than treating signals as collections of local tokens or patches, our approach assumes that clinically meaningful structure arises from temporally extended, interacting events whose boundaries and dynamics are not directly observed. To capture this structure, we introduce a self supervised learning framework that enforces consistency across stochastic segmentations and time frequency projections of the same waveform, encouraging representations that are invariant to signal level perturbations while preserving event level organization. The resulting model combines a segmentation aware encoder with a latent interaction operator that captures dependencies among inferred events, and naturally extends to multimodal settings by aligning modalities through shared event representations. Across a range of physiological benchmarks, including arrhythmia classification, hemodynamic prediction, and waveform retrieval, the proposed method improves performance, robustness, and label efficiency relative to strong sequence based baselines. These results suggest that shifting from signal centric to event centric representations provides a more appropriate inductive bias for modeling physiological dynamics and offers a complementary path to scaling foundation models in healthcare.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 56 of its 81 references that are in the map. First posted on arXiv 9 May 2026.

Builds on

56 of 81 references.

References · 56

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  8. 2023Segment Anythingcited by 8,158
  9. 2023Visual Instruction Tuningcited by 7,792
  10. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  11. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  12. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
38 more
  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  2. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  3. 2023A Survey of Large Language Modelscited by 2,537
  4. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  5. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  6. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
  7. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
  8. 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
  9. 2019Contrastive Representation Distillationcited by 734
  10. 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 717
  11. 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 430
  12. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
  13. 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
  14. 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 234
  15. 2019Cross Attention Network for Few-shot Classificationcited by 218
  16. 2022UNETR++: Delving into Efficient and Accurate 3D Medical Image Segmentationcited by 112
  17. 2023Large-scale Training of Foundation Models for Wearable Biosignalscited by 89
  18. 2020Language Models Are An Effective Patient Representation Learning Technique For Electronic Health Record Datacited by 85
  19. 2024Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directionscited by 77
  20. 2023MOTOR: A Time-To-Event Foundation Model For Structured Medical Recordscited by 75
  21. 2025MedHELM: Holistic Evaluation of Large Language Models for Medical Taskscited by 60
  22. 2024Context Clues: Evaluating Long Context Models for Clinical Prediction Tasks on EHRscited by 39
  23. 2024EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Recordscited by 31
  24. 2025Clinical ModernBERT: An efficient and long context encoder for biomedical textcited by 26
  25. 2023Frequency-Aware Masked Autoencoders for Multimodal Pretraining on Biosignalscited by 22
  26. 2024Emergency Department Decision Support using Clinical Pseudo-notescited by 22
  27. 2024Can Large Language Models abstract Medical Coded Language?cited by 20
  28. 2024CORE-BEHRT: A Carefully Optimized and Rigorously Evaluated BEHRTcited by 20
  29. 2025GENERator: A Long-Context Generative Genomic Foundation Modelcited by 20
  30. 2024E3D-GPT: Enhanced 3D Visual Foundation for Medical Vision-Language Modelcited by 19
  31. 2025HiMAE: Hierarchical Masked Autoencoders Discover Resolution-Specific Structure in Wearable Time Seriescited by 19
  32. 2024Text Serialization and Their Relationship with the Conventional Paradigms of Tabular Machine Learningcited by 17
  33. 2023E2ENet: Dynamic Sparse Feature Fusion for Accurate and Efficient 3D Medical Image Segmentationcited by 16
  34. 2025A Case Study Exploring the Current Landscape of Synthetic Medical Record Generation with Commercial LLMscited by 13
  35. 2025ChronoFormer: Time-Aware Transformer Architectures for Structured Clinical Event Modelingcited by 11
  36. 2025Foundation models for electronic health records: representation dynamics and transferabilitycited by 11
  37. 2024GenBench: A Benchmarking Suite for Systematic Evaluation of Genomic Foundation Modelscited by 10
  38. 2024Contrastive Learning of Preferences with a Contextual InfoNCE Losscited by 9

50 most cited of 56 All 56 (JSON)

Built on by

Not cited yet.