Compact Latent Manifold Translation: A Parameter-Efficient Foundation Model for Cross-Modal and Cross-Frequency Physiological Signal Synthesis
Not on the map. Why?
Abstract (arXiv)
The analysis of physiological time series, such as electrocardiograms (ECG) and photoplethysmograms (PPG), is persistently hindered by modality and frequency gaps stemming from heterogeneous recording devices. Existing foundation models typically rely on continuous latent spaces, which frequently suffer from severe modality entanglement, lack high-fidelity cross-frequency generative capacity, and impose high computational costs that prohibit edge-device deployment. In this paper, we propose Compact Latent Manifold Translation (CLMT), a highly parameter-efficient (0.09B) unified framework that bridges these gaps through a novel two-stage discrete translation paradigm. First, we introduce a Universal Tokenizer utilizing Hierarchical Residual Vector Quantization (RVQ) to decouple heterogeneous signals into isolated, well-structured discrete latent manifolds, effectively preventing inter-modality interference. Second, a Context-Prompted Latent Translator maps these discrete tokens across modalities by integrating static physiological priors, reframing complex signal synthesis as a pure latent sequence translation task. Extensive evaluations demonstrate that our 0.09B model significantly outperforms massive baselines. In cross-modal PPG-to-ECG synthesis, it resolves temporal phase drift and dramatically improves the clinical R-peak detection F1-score from 0.37 (baseline) to 0.83. Furthermore, in extreme cross-frequency super-resolution (25Hz to 100Hz), it successfully recovers high-frequency diagnostic landmarks, achieving an unprecedented Pearson correlation of 0.9956. By learning a universal discrete language for biological signals with a fraction of the computational footprint, our approach sets a new trajectory for edge-deployable, multi-modal medical foundation models.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
19 of 30 references.
References · 19
- 2017Attention Is All You Needcited by 60,106
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,364
- 2017Neural Discrete Representation Learningcited by 4,680
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,016
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,043
- 2022High Fidelity Neural Audio Compressioncited by 680
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 613
- 2024A Systematic Review of Intermediate Fusion in Multimodal Deep Learning for Biomedical Applicationscited by 25
- 2024Boosting Masked ECG-Text Auto-Encoders as Discriminative Learnerscited by 16
- 2025Neural Codecs as Biosignal Tokenizerscited by 13
- 2025Towards Robust Multimodal Physiological Foundation Models: Handling Arbitrary Missing Modalitiescited by 11
- 2024Uncertainty-Aware PPG-2-ECG for Enhanced Cardiovascular Diagnosis using Diffusion Modelscited by 8
7 more
- 2025PPGFlowECG: Latent Rectified Flow with Cross-Modal Encoding for PPG-Guided ECG Generation and Cardiovascular Disease Detectioncited by 7
- 2025CLEF: Clinically-Guided Contrastive Learning for Electrocardiogram Foundation Modelscited by 7
- 2026BrainRVQ: A High-Fidelity EEG Foundation Model via Dual-Domain Residual Quantization and Hierarchical Autoregressioncited by 4
- 2026RhythmBERT: A Self-Supervised Language Model Based on Latent Representations of ECG Waveforms for Heart Disease Detectioncited by 3
- 2025Multi-scale Masked Autoencoder for Electrocardiogram Anomaly Detectioncited by 2
- 2025Sensing Cardiac Health Across Scenarios and Devices: A Multi-Modal Foundation Model Pretrained on Heterogeneous Data from 1.7 Million Individualscited by 2
- 2026Toward Resource-Efficient Collaboration of Large AI Models in Mobile Edge Networkscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Toward World Modeling of Physiological Signals with Chaos-Theoretic Balancing and Latent Dynamics
- 2026Cylindrical Geodesic Flow Matching for Quasiperiodic Physiological Signal Transformation
- 2025H-LDM: Hierarchical Latent Diffusion Models for Controllable and Interpretable PCG Synthesis from Clinical Metadata
- 2026VAMP-Diff: VampPrior Latent Diffusion for Photoplethysmography Modeling
- 2025High-Fidelity Synthetic ECG Generation via Mel-Spectrogram Informed Diffusion Training
- 2025Manifold-Aware Diffusion-Augmented Contrastive Learning for Noise-Robust Biosignal Representation
- 2024Constraint Latent Space Matters: An Anti-anomalous Waveform Transformation Solution from Photoplethysmography to Arterial Blood Pressure
- 2026PG-LRF: Physiology-Guided Latent Rectified Flow for Electro-Hemodynamic PPG-to-ECG Generation