mlsanityData to 7 Oct 2026

A Large Sensor Foundation Model Pretrained on Continuous Glucose Monitor Data for Diabetes Management

arXiv 2412.09727 ↗First posted 12 Dec 2024q-bio.QM cs.AI cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Continuous glucose monitoring (CGM) combined with AI offers new opportunities for proactive diabetes management through real-time glucose forecasting. However, most existing models are task-specific and lack generalization across patient populations. Inspired by the autoregressive paradigm of large language models, we introduce CGM-LSM, a Transformer decoder-based Large Sensor Model (LSM) pretrained on 1.6 million CGM records from patients with different diabetes types, ages, and genders. We model patients as sequences of glucose time steps to learn latent knowledge embedded in CGM data and apply it to the prediction of glucose readings for a 2-hour horizon. Compared with prior methods, CGM-LSM significantly improves prediction accuracy and robustness: a 48.51% reduction in root mean square error in one-hour horizon forecasting and consistent zero-shot prediction performance across held-out patient groups. We analyze model performance variations across patient subgroups and prediction scenarios and outline key opportunities and challenges for advancing CGM foundation models.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 10 of its 42 references that are in the map. First posted on arXiv 12 Dec 2024.

Builds on

10 of 42 references.

References · 10

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  4. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  7. 2024Chronos: Learning the Language of Time Seriescited by 712
  8. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  9. 2022On Decoding Strategies for Neural Text Generatorscited by 89
  10. 2018Convolutional Recurrent Neural Networks for Glucose Predictioncited by 20

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.