# Joint Attention Mechanism Learning to Facilitate Opto-physiological Monitoring during Physical Activity

arXiv: https://arxiv.org/abs/2502.09291 · HTML: https://mlsanity.com/paper/2502.09291/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 10 of its 32 references that are in the map.
- First posted on arXiv 13 Feb 2025.

## Builds on (most cited first, 10 of 10)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [TROIKA: A General Framework for Heart Rate Monitoring Using Wrist-Type Photoplethysmographic Signals During Intensive Physical Exercise](https://mlsanity.com/paper/1409.5181/) (2014)
- [CardioGAN: Attentive Generative Adversarial Network with Dual Discriminators for Synthesis of ECG from PPG](https://mlsanity.com/paper/2010.00104/) (2020)
- [Photoplethysmography-Based Heart Rate Monitoring in Physical Activities via Joint Sparse Spectrum Reconstruction](https://mlsanity.com/paper/1503.00688/) (2015)
- [Q-PPG: Energy-Efficient PPG-based Heart Rate Monitoring on Wearable Devices](https://mlsanity.com/paper/2203.14907/) (2022)
- [An Accurate Non-accelerometer-based PPG Motion Artifact Removal Technique using CycleGAN](https://mlsanity.com/paper/2106.11512/) (2021)
- [KID-PPG: Knowledge Informed Deep Learning for Extracting Heart Rate from a Smartwatch](https://mlsanity.com/paper/2405.09559/) (2024)
- [Robust and Energy-efficient PPG-based Heart-Rate Monitoring](https://mlsanity.com/paper/2203.16339/) (2022)
- [SPECMAR: Fast Heart Rate Estimation from PPG Signal using a Modified Spectral Subtraction Scheme with Composite Motion Artifacts Reference Generation](https://mlsanity.com/paper/1810.06196/) (2018)

## Abstract (arXiv)

Opto-physiological monitoring including photoplethysmography (PPG) provides non-invasive cardiac and respiratory measurements, yet motion artefacts (MAs) during physical activity degrade its signal quality and downstream estimation concurrently. An attention-mechanism-based generative adversarial network (AM-GAN) was proposed to model motion artefacts and mitigate their impact on raw PPG signals. The AM-GAN learns how to transform motion-affected PPG into artefact-reduced waveforms to align with triaxial acceleration signals corresponding to artefact components gained from a triaxial accelerometer. The AM-GAN has been validated across four experimental protocols with 43 participants performing activities from low to high intensity (6--12km/h). With the public datasets, the AM-GAN achieves mean absolute error (MAE) for heart rate (HR) of 1.81 beats/min on IEEE-SPC and 3.86 beats/min on PPGDalia. On the in-house LU dataset, it shows the MAEs < 1.37 beats/min for HR and 2.49 breaths/min for respiratory rate (RR). A further in-house C2 dataset with three oxygen levels (16%, 18%, and 21%) was applied in the AM-GAN to attain a MAE of 1.65% for SpO2. The outcome demonstrates that the AM-GAN offers a robust and reliable physiological estimation under various intensities of physical activity.