BioX-Bridge: Model Bridging for Unsupervised Cross-Modal Knowledge Transfer across Biosignals
Not on the map. Why?
Abstract (arXiv)
Biosignals offer valuable insights into the physiological states of the human body. Although biosignal modalities differ in functionality, signal fidelity, sensor comfort, and cost, they are often intercorrelated, reflecting the holistic and interconnected nature of human physiology. This opens up the possibility of performing the same tasks using alternative biosignal modalities, thereby improving the accessibility, usability, and adaptability of health monitoring systems. However, the limited availability of large labeled datasets presents challenges for training models tailored to specific tasks and modalities of interest. Unsupervised cross-modal knowledge transfer offers a promising solution by leveraging knowledge from an existing modality to support model training for a new modality. Existing methods are typically based on knowledge distillation, which requires running a teacher model alongside student model training, resulting in high computational and memory overhead. This challenge is further exacerbated by the recent development of foundation models that demonstrate superior performance and generalization across tasks at the cost of large model sizes. To this end, we explore a new framework for unsupervised cross-modal knowledge transfer of biosignals by training a lightweight bridge network to align the intermediate representations and enable information flow between foundation models and across modalities. Specifically, we introduce an efficient strategy for selecting alignment positions where the bridge should be constructed, along with a flexible prototype network as the bridge architecture. Extensive experiments across multiple biosignal modalities, tasks, and datasets show that BioX-Bridge reduces the number of trainable parameters by 88--99% while maintaining or even improving transfer performance compared to state-of-the-art methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 46 of its 68 references that are in the map. First posted on arXiv 2 Oct 2025.
Builds on
46 of 68 references.
References · 46
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023GPT-4 Technical Reportcited by 18,132
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2022Generative Adversarial Networkscited by 5,603
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2019Contrastive Representation Distillationcited by 734
- 2018A Survey of Unsupervised Deep Domain Adaptationcited by 361
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
- 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 246
34 more
- 2016SoundNet: Learning Sound Representations from Unlabeled Videocited by 244
- 2014Understanding image representations by measuring their equivariance and equivalencecited by 240
- 2021Revisiting Model Stitching to Compare Neural Representationscited by 203
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
- 2022Relative representations enable zero-shot latent space communicationcited by 175
- 2015Cross Modal Distillation for Supervision Transfercited by 173
- 2023Large-scale Training of Foundation Models for Wearable Biosignalscited by 89
- 2024ECG-FM: An Open Electrocardiogram Foundation Modelcited by 89
- 2018Modality Distillation with Multiple Stream Networks for Action Recognitioncited by 83
- 2022Deep Model Reassemblycited by 78
- 2021Similarity and Matching of Neural Network Representationscited by 77
- 2024PaPaGei: Open Foundation Models for Optical Physiological Signalscited by 64
- 2024Scaling Wearable Foundation Modelscited by 57
- 2024EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Modelcited by 51
- 2024SleepFM: Multi-modal Representation Learning for Sleep Across Brain Activity, ECG and Respiratory Signalscited by 38
- 2025Pulse-PPG: An Open-Source Field-Trained PPG Foundation Model for Wearable Applications Across Lab and Field Settingscited by 35
- 2020CardioGAN: Attentive Generative Adversarial Network with Dual Discriminators for Synthesis of ECG from PPGcited by 34
- 2024Toward Foundation Model for Multivariate Wearable Sensing of Physiological Signalscited by 29
- 2024An Electrocardiogram Foundation Model Built on over 10 Million Recordings with External Evaluation across Multiple Domainscited by 27
- 2021Multimodal Knowledge Expansioncited by 26
- 2023Stitchable Neural Networkscited by 26
- 2023BioBridge: Bridging Biomedical Foundation Models via Knowledge Graphscited by 24
- 2023Frequency-Aware Masked Autoencoders for Multimodal Pretraining on Biosignalscited by 22
- 2017Heterogeneous domain adaptation: An unsupervised approachcited by 17
- 2021MRI to PET Cross-Modality Translation using Globally and Locally Aware GAN (GLA-GAN) for Multi-Modal Diagnosis of Alzheimer's Diseasecited by 16
- 2024Brant-X: A Unified Physiological Signal Alignment Frameworkcited by 16
- 2019Cascade Attention Guided Residue Learning GAN for Cross-Modal Translationcited by 14
- 2024Promoting cross-modal representations to improve multimodal foundation models for physiological signalscited by 13
- 2025GPT-PPG: A GPT-based Foundation Model for Photoplethysmography Signalscited by 12
- 2024Towards Modality Generalization: A Benchmark and Prospective Analysiscited by 10
- 2025Large Cognition Model: Towards Pretrained EEG Foundation Modelcited by 10
- 2025A Simple Review of EEG Foundation Models: Datasets, Advancements and Future Perspectivescited by 10
- 2023Efficient Stitchable Task Adaptationcited by 4
- 2025Heterogeneous-Modal Unsupervised Domain Adaptation via Latent Space Bridgingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.