mlsanityData to 14 Oct 2026

Wavelet-Driven Masked Multiscale Reconstruction for PPG Foundation Models

arXiv 2601.12215 ↗First posted 18 Jan 2026cs.LG cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Wearable foundation models have the potential to transform digital health by learning transferable representations from large-scale biosignals collected in everyday settings. While recent progress has been made in large-scale pretraining, most approaches overlook the spectral structure of photoplethysmography (PPG) signals, wherein physiological rhythms unfold across multiple frequency bands. Motivated by the insight that many downstream health-related tasks depend on multi-resolution features spanning fine-grained waveform morphology to global rhythmic dynamics, we introduce Masked Multiscale Reconstruction (MMR) for PPG representation learning - a self-supervised pretraining framework that explicitly learns from hierarchical time-frequency scales of PPG data. The pretraining task is designed to reconstruct randomly masked out coefficients obtained from a wavelet-based multiresolution decomposition of PPG signals, forcing the transformer encoder to integrate information across temporal and spectral scales. We pretrain our model with MMR using ~17 million unlabeled 10-second PPG segments from ~32,000 smartwatch users. On 17 of 19 diverse health-related tasks, MMR trained on large-scale wearable PPG data improves over or matches state-of-the-art open-source PPG foundation models, time-series foundation models, and other self-supervised baselines. Extensive analysis of our learned embeddings and systematic ablations underscores the value of wavelet-based representations, showing that they capture robust and physiologically-grounded features. Together, these results highlight the potential of MMR as a step toward generalizable PPG foundation models.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 20 of its 72 references that are in the map. First posted on arXiv 18 Jan 2026.

Builds on

20 of 72 references.

References · 20

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  5. 2024Chronos: Learning the Language of Time Seriescited by 759
  6. 2022Masked Siamese Networks for Label-Efficient Learningcited by 302
  7. 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 250
  8. 2023Large-scale Training of Foundation Models for Wearable Biosignalscited by 95
  9. 2024PaPaGei: Open Foundation Models for Optical Physiological Signalscited by 69
  10. 2024Scaling Wearable Foundation Modelscited by 63
  11. 2025Pulse-PPG: An Open-Source Field-Trained PPG Foundation Model for Wearable Applications Across Lab and Field Settingscited by 37
  12. 2024Enhancing Foundation Models for Time Series Forecasting via Wavelet-based Tokenizationcited by 27
8 more
  1. 2023Frequency-Aware Masked Autoencoders for Multimodal Pretraining on Biosignalscited by 23
  2. 2025LSM-2: Learning from Incomplete Wearable Sensor Datacited by 23
  3. 2024Emergency Department Decision Support using Clinical Pseudo-notescited by 22
  4. 2025HiMAE: Hierarchical Masked Autoencoders Discover Resolution-Specific Structure in Wearable Time Seriescited by 19
  5. 2025Beyond Sensor Data: Foundation Models of Behavioral Data from Wearables Improve Health Predictionscited by 18
  6. 2024Wearable Accelerometer Foundation Models for Health via Knowledge Distillationcited by 16
  7. 2025PhysioWave: A Multi-Scale Wavelet-Transformer for Physiological Signal Representationcited by 12
  8. 2024Frequency-Masked Embedding Inference: A Non-Contrastive Approach for Time Series Representation Learningcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.