Assessing Foundation Models' Transferability to Physiological Signals in Precision Medicine
Not on the map. Why?
Abstract (arXiv)
The success of precision medicine requires computational models that can effectively process and interpret diverse physiological signals across heterogeneous patient populations. While foundation models have demonstrated remarkable transfer capabilities across various domains, their effectiveness in handling individual-specific physiological signals - crucial for precision medicine - remains largely unexplored. This work introduces a systematic pipeline for rapidly and efficiently evaluating foundation models' transfer capabilities in medical contexts. Our pipeline employs a three-stage approach. First, it leverages physiological simulation software to generate diverse, clinically relevant scenarios, particularly focusing on data-scarce medical conditions. This simulation-based approach enables both targeted capability assessment and subsequent model fine-tuning. Second, the pipeline projects these simulated signals through the foundation model to obtain embeddings, which are then evaluated using linear methods. This evaluation quantifies the model's ability to capture three critical aspects: physiological feature independence, temporal dynamics preservation, and medical scenario differentiation. Finally, the pipeline validates these representations through specific downstream medical tasks. Initial testing of our pipeline on the Moirai time series foundation model revealed significant limitations in physiological signal processing, including feature entanglement, temporal dynamics distortion, and reduced scenario discrimination. These findings suggest that current foundation models may require substantial architectural modifications or targeted fine-tuning before deployment in clinical settings.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 7 of its 15 references that are in the map. First posted on arXiv 4 Dec 2024.
Builds on
7 of 15 references.
References · 7
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
- 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 234
- 2024Capabilities of Gemini Models in Medicinecited by 231
- 2023To Transformers and Beyond: Large Language Models for the Genomecited by 15
Built on by
Citing papers per year: 2026: 1.
1 paper.