CIG-MAE: Cross-Modal Information-Guided Masked Autoencoder for Self-Supervised WiFi Sensing
Not on the map. Why?
Abstract (arXiv)
Human Action Recognition using WiFi Channel State Information (CSI) has emerged as an attractive alternative to vision-based methods due to its ubiquity, device-agnostic nature, and inherent privacy-preserving capabilities. However, the high cost of manual annotation and the limited scale of publicly available CSI datasets restrict the performance of supervised approaches. Self-supervised learning (SSL) offers a promising avenue, but existing contrastive paradigms rely on data augmentations that conflict with the physical semantics of radio signals and require large-batch training, making them poorly suited for CSI. To overcome these challenges, we introduce CIG-MAE -- a Cross-modal Information-Guided Masked Autoencoder -- that reconstructs both the amplitude and phase of CSI using a symmetric dual-stream architecture with a high masking ratio. Specifically, we propose an Adaptive Information-Guided Masking strategy that dynamically allocates attention to time-frequency regions with high information density to improve learning efficiency, and incorporate a Barlow Twins regularizer to align cross-modal representations without negative samples. Experiments on three public datasets show that CIG-MAE consistently outperforms SOTA SSL methods and even surpasses a fully supervised baseline, demonstrating superior data efficiency, robustness, and representation generalization.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 75 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
42 of 75 references.
References · 42
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2020DISK: Learning local features with policy gradientcited by 310
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
- 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 205
30 more
- 2022What to Hide from Your Students: Attention-Guided Masked Image Modelingcited by 117
- 2021Efficient Training of Visual Transformers with Small Datasetscited by 107
- 2018On Learning Intrinsic Rewards for Policy Gradient Methodscited by 100
- 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 97
- 2020Contrastive Predictive Coding for Human Activity Recognitioncited by 54
- 2022Understanding Masked Image Modeling via Learning Occlusion Invariant Featurecited by 50
- 2022AdaMAE: Adaptive Masking for Efficient Spatiotemporal Learning with Masked Autoencoderscited by 41
- 2022Digital Twin of Wireless Systems: Overview, Taxonomy, Challenges, and Opportunitiescited by 40
- 2020Federated Self-Supervised Learning of Multi-Sensor Representations for Embedded Intelligencecited by 39
- 2022SenseFi: A Library and Benchmark on Deep-Learning-Empowered WiFi Human Sensingcited by 34
- 2020Sense and Learn: Self-Supervision for Omnipresent Sensorscited by 21
- 2024WiMANS: A Benchmark Dataset for WiFi-based Multi-user Activity Sensingcited by 18
- 2023A Survey on Digital Twins: Architecture, Enabling Technologies, Security and Privacy, and Future Prospectscited by 16
- 2022AutoFi: Towards Automatic WiFi Human Sensing via Geometric Self-Supervised Learningcited by 15
- 2023SiFall: Practical Online Fall Detection with RF Sensingcited by 15
- 2025A Multi-Task Foundation Model for Wireless Channel Representation Using Contrastive and Masked Autoencoder Learningcited by 15
- 2024Transfer Learning in Human Activity Recognition: A Surveycited by 14
- 2025A Tutorial-cum-Survey on Self-Supervised Learning for Wi-Fi Sensing: Trends, Challenges, and Outlookcited by 11
- 2025Cognitive Edge Computing: A Comprehensive Survey on Optimizing Large Models and AI Agents for Pervasive Deploymentcited by 10
- 2019WiFi-based Real-time Breathing and Heart Rate Monitoring during Sleepcited by 9
- 2024RFBoost: Understanding and Boosting Deep WiFi Sensing via Physical Data Augmentationcited by 9
- 2021Self-Supervised WiFi-Based Activity Recognitioncited by 6
- 2022Simple and Effective Augmentation Methods for CSI Based Indoor Localizationcited by 6
- 2024Data Augmentation Techniques for Cross-Domain WiFi CSI-based Human Activity Recognitioncited by 5
- 2024Diffusion Model-based Contrastive Learning for Human Activity Recognitioncited by 4
- 2024Context-Aware Predictive Coding: A Representation Learning Framework for WiFi Sensingcited by 4
- 2024Autosen: improving automatic wifi human sensing through cross-modal autoencodercited by 3
- 2024MaskFi: Unsupervised Learning of WiFi and Vision Representations for Multimodal Human Activity Recognitioncited by 3
- 2021Single-Target Real-Time Passive WiFi Trackingcited by 2
- 2023Self-Supervised Learning for WiFi CSI-Based Human Activity Recognition: A Systematic Studycited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.