# A Short Overview of Multi-Modal Wi-Fi Sensing

arXiv: https://arxiv.org/abs/2505.06682 · HTML: https://mlsanity.com/paper/2505.06682/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 26 of its 65 references that are in the map.
- First posted on arXiv 10 May 2025.

## Builds on (most cited first, 26 of 26)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [Learning Transferable Visual Models From Natural Language Supervision](https://mlsanity.com/paper/2103.00020/) (2021)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Distilling the Knowledge in a Neural Network](https://mlsanity.com/paper/1503.02531/) (2015)
- [Mask R-CNN](https://mlsanity.com/paper/1703.06870/) (2017)
- [You Only Look Once: Unified, Real-Time Object Detection](https://mlsanity.com/paper/1506.02640/) (2015)
- [Neural Discrete Representation Learning](https://mlsanity.com/paper/1711.00937/) (2017)
- [Domain-Adversarial Training of Neural Networks](https://mlsanity.com/paper/1505.07818/) (2015)
- [Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields](https://mlsanity.com/paper/1611.08050/) (2016)
- [WirelessGPT: A Generative Pre-trained Multi-task Learning Framework for Wireless Communication](https://mlsanity.com/paper/2502.06877/) (2025)
- [Finding the Missing Data: A BERT-inspired Approach Against Package Loss in Wireless Sensing](https://mlsanity.com/paper/2403.12400/) (2024)
- [X-Fi: A Modality-Invariant Foundation Model for Multimodal Human Sensing](https://mlsanity.com/paper/2410.10167/) (2024)
- [CSI-BERT2: A BERT-inspired Framework for Efficient CSI Prediction and Classification in Wireless Communication and Sensing](https://mlsanity.com/paper/2412.06861/) (2024)
- [CrossFi: A Cross Domain Wi-Fi Sensing Framework Based on Siamese Network](https://mlsanity.com/paper/2408.10919/) (2024)
- [BERT4MIMO: A Foundation Model using BERT Architecture for Massive MIMO Channel State Information Prediction](https://mlsanity.com/paper/2501.01802/) (2025)
- [A Survey on Wi-Fi Sensing Generalizability: Taxonomy, Techniques, Datasets, and Future Research Prospects](https://mlsanity.com/paper/2503.08008/) (2025)
- [Babel: A Scalable Pre-trained Model for Multi-Modal Sensing via Expandable Modality Alignment](https://mlsanity.com/paper/2407.17777/) (2024)
- [Csi-LLM: A Novel Downlink Channel Prediction Method Aligned with LLM Pre-Training](https://mlsanity.com/paper/2409.00005/) (2024)
- [Autosen: improving automatic wifi human sensing through cross-modal autoencoder](https://mlsanity.com/paper/2401.05440/) (2024)
- [MaskFi: Unsupervised Learning of WiFi and Vision Representations for Multimodal Human Activity Recognition](https://mlsanity.com/paper/2402.19258/) (2024)
- [Wi-Fi 8: Embracing the Millimeter-Wave Era](https://mlsanity.com/paper/2309.16813/) (2023)
- [LoFi: Vision-Aided Label Generator for Wi-Fi Localization and Tracking](https://mlsanity.com/paper/2412.05074/) (2024)
- [ViFi-ReID: A Two-Stream Vision-WiFi Multimodal Approach for Person Re-identification](https://mlsanity.com/paper/2410.09875/) (2024)

## Abstract (arXiv)

Wi-Fi sensing has emerged as a significant technology in wireless sensing and Integrated Sensing and Communication (ISAC), offering benefits such as low cost, high penetration, and enhanced privacy. Currently, it is widely utilized in various applications, including action recognition, human localization, and crowd counting. However, Wi-Fi sensing also faces challenges, such as low robustness and difficulties in data collection. Recently, there has been an increasing focus on multi-modal Wi-Fi sensing, where other modalities can act as teachers, providing ground truth or robust features for Wi-Fi sensing models to learn from, or can be directly fused with Wi-Fi for enhanced sensing capabilities. Although these methods have demonstrated promising results and substantial value in practical applications, there is a lack of comprehensive surveys reviewing them. To address this gap, this paper reviews the multi-modal Wi-Fi sensing literature from the past 24 months and highlights the current limitations, challenges and future directions in this field.