mlsanityData to 14 Oct 2026

Federated Timeline Synthesis: Scalable and Private Methodology For Model Training and Deployment

arXiv 2506.23358 ↗First posted 29 Jun 2025cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

We present Federated Timeline Synthesis (FTS), a novel framework for training generative foundation models across distributed timeseries data applied to electronic health records (EHR). At its core, FTS represents patient history as tokenized Patient Health Timelines (PHTs), language-agnostic sequences encoding temporal, categorical, and continuous clinical information. Each institution trains an autoregressive transformer on its local PHTs and transmits only model weights to a central server. The server uses the generators to synthesize a large corpus of trajectories and train a Global Generator (GG), enabling zero-shot inference via Monte Carlo simulation of future PHTs. We evaluate FTS on five clinically meaningful prediction tasks using MIMIC-IV data, showing that models trained on synthetic data generated by GG perform comparably to those trained on real data. FTS offers strong privacy guarantees, scalability across institutions, and extensibility to diverse prediction and simulation tasks especially in healthcare, including counterfactual inference, early warning detection, and synthetic trial design.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 32 references that are in the map. First posted on arXiv 29 Jun 2025.

Builds on

19 of 32 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  3. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  4. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  5. 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
  6. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
  7. 2019BEHRT: Transformer for Electronic Health Recordscited by 263
  8. 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
  9. 2017Generating Multi-label Discrete Patient Records using Generative Adversarial Networkscited by 197
  10. 2023MOTOR: A Time-To-Event Foundation Model For Structured Medical Recordscited by 78
  11. 2024Zero Shot Health Trajectory Prediction Using Transformercited by 77
  12. 2020Differentially Private Synthetic Medical Data Generation using Convolutional GANscited by 52
7 more
  1. 2023Recent Advances on Federated Learning: A Systematic Surveycited by 41
  2. 2021Emerging Trends in Federated Learning: From Model Fusion to Federated X Learningcited by 35
  3. 2022FedSyn: Synthetic Data Generation using Federated Learningcited by 7
  4. 2021Generation of Synthetic Electronic Health Records Using a Federated GANcited by 5
  5. 2024How Deep is your Guess? A Fresh Perspective on Deep Learning for Medical Time-Series Imputationcited by 5
  6. 2025Generating Clinically Realistic EHR Data via a Hierarchy- and Semantics-Guided Transformercited by 4
  7. 2023Trading Off Scalability, Privacy, and Performance in Data Synthesiscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.