More to Less (M2L): Enhanced Health Recognition in the Wild with Reduced Modality of Wearable Sensors
Not on the map. Why?
Abstract (arXiv)
Accurately recognizing health-related conditions from wearable data is crucial for improved healthcare outcomes. To improve the recognition accuracy, various approaches have focused on how to effectively fuse information from multiple sensors. Fusing multiple sensors is a common scenario in many applications, but may not always be feasible in real-world scenarios. For example, although combining bio-signals from multiple sensors (i.e., a chest pad sensor and a wrist wearable sensor) has been proved effective for improved performance, wearing multiple devices might be impractical in the free-living context. To solve the challenges, we propose an effective more to less (M2L) learning framework to improve testing performance with reduced sensors through leveraging the complementary information of multiple modalities during training. More specifically, different sensors may carry different but complementary information, and our model is designed to enforce collaborations among different modalities, where positive knowledge transfer is encouraged and negative knowledge transfer is suppressed, so that better representation is learned for individual modalities. Our experimental results show that our framework achieves comparable performance when compared with the full modalities. Our code and results will be available at https://github.com/compwell-org/More2Less.git.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 6 of its 17 references that are in the map. First posted on arXiv 16 Feb 2022.
Builds on
6 of 17 references.
References · 6
- 2022Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Predictioncited by 277
- 2021What Makes Multi-modal Learning Better than Single (Provably)cited by 151
- 2020Self-supervised transfer learning of physiological representations from free-living wearable datacited by 27
- 2020TILES-2018, a longitudinal physiologic and behavioral data set of hospital workerscited by 13
- 2016Training and Evaluating Multimodal Word Embeddings with Large-scale Web Annotated Imagescited by 7
- 2021Modality Fusion Network and Personalized Attention in Momentary Stress Detection in the Wildcited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 1.
3 papers.