# A Multimodal Dangerous State Recognition and Early Warning System for Elderly with Intermittent Dementia

arXiv: https://arxiv.org/abs/2405.20136 · HTML: https://mlsanity.com/paper/2405.20136/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 4 of its 56 references that are in the map.
- First posted on arXiv 30 May 2024.

## Builds on (most cited first, 4 of 4)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Exploring Self-attention for Image Recognition](https://mlsanity.com/paper/2004.13621/) (2020)
- [Semi-supervised Learning with Network Embedding on Ambient RF Signals for Geofencing Services](https://mlsanity.com/paper/2210.07889/) (2022)
- [Detecting Wandering Behavior of People with Dementia](https://mlsanity.com/paper/2110.13128/) (2021)

## Abstract (arXiv)

In response to the social issue of the increasing number of elderly vulnerable groups going missing due to the aggravating aging population in China, our team has developed a wearable anti-loss device and intelligent early warning system for elderly individuals with intermittent dementia using artificial intelligence and IoT technology. This system comprises an anti-loss smart helmet, a cloud computing module, and an intelligent early warning application on the caregiver's mobile device. The smart helmet integrates a miniature camera module, a GPS module, and a 5G communication module to collect first-person images and location information of the elderly. Data is transmitted remotely via 5G, FTP, and TCP protocols. In the cloud computing module, our team has proposed for the first time a multimodal dangerous state recognition network based on scene and location information to accurately assess the risk of elderly individuals going missing. Finally, the application software interface designed for the caregiver's mobile device implements multi-level early warnings. The system developed by our team requires no operation or response from the elderly, achieving fully automatic environmental perception, risk assessment, and proactive alarming. This overcomes the limitations of traditional monitoring devices, which require active operation and response, thus avoiding the issue of the digital divide for the elderly. It effectively prevents accidental loss and potential dangers for elderly individuals with dementia.