# Human Silhouette and Skeleton Video Synthesis through Wi-Fi signals

arXiv: https://arxiv.org/abs/2203.05864 · HTML: https://mlsanity.com/paper/2203.05864/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 34 of its 103 references that are in the map.
- First posted on arXiv 11 Mar 2022.

## Builds on (most cited first, 30 of 34)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift](https://mlsanity.com/paper/1502.03167/) (2015)
- [Image-to-Image Translation with Conditional Adversarial Networks](https://mlsanity.com/paper/1611.07004/) (2016)
- [Rethinking Atrous Convolution for Semantic Image Segmentation](https://mlsanity.com/paper/1706.05587/) (2017)
- [Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks](https://mlsanity.com/paper/1511.06434/) (2015)
- [OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields](https://mlsanity.com/paper/1812.08008/) (2018)
- [Striving for Simplicity: The All Convolutional Net](https://mlsanity.com/paper/1412.6806/) (2014)
- [StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks](https://mlsanity.com/paper/1612.03242/) (2016)
- [Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling](https://mlsanity.com/paper/1610.07584/) (2016)
- [LSTM: A Search Space Odyssey](https://mlsanity.com/paper/1503.04069/) (2015)
- [Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in vitro](https://mlsanity.com/paper/1701.07717/) (2017)
- [Pluralistic Image Completion](https://mlsanity.com/paper/1903.04227/) (2019)
- [SketchyGAN: Towards Diverse and Realistic Sketch to Image Synthesis](https://mlsanity.com/paper/1801.02753/) (2018)
- [Scribbler: Controlling Deep Image Synthesis with Sketch and Color](https://mlsanity.com/paper/1612.00835/) (2016)
- [Unsupervised Attention-guided Image to Image Translation](https://mlsanity.com/paper/1806.02311/) (2018)
- [Person-in-WiFi: Fine-grained Person Perception using WiFi](https://mlsanity.com/paper/1904.00276/) (2019)
- [An Experimental Review on Deep Learning Architectures for Time Series Forecasting](https://mlsanity.com/paper/2103.12057/) (2021)
- [Identity-Aware CycleGAN for Face Photo-Sketch Synthesis and Recognition](https://mlsanity.com/paper/2103.16019/) (2021)
- [Unsupervised Person Image Generation with Semantic Parsing Transformation](https://mlsanity.com/paper/1904.03379/) (2019)
- [Cross-view image synthesis using geometry-guided conditional GANs](https://mlsanity.com/paper/1808.05469/) (2018)
- [Speech2Action: Cross-modal Supervision for Action Recognition](https://mlsanity.com/paper/2003.13594/) (2020)
- [Learning Longterm Representations for Person Re-Identification Using Radio Signals](https://mlsanity.com/paper/2004.01091/) (2020)
- [Text Guided Person Image Synthesis](https://mlsanity.com/paper/1904.05118/) (2019)
- [A 3D GAN for Improved Large-pose Facial Recognition](https://mlsanity.com/paper/2012.10545/) (2020)
- [AF-DCGAN: Amplitude Feature Deep Convolutional GAN for Fingerprint Construction in Indoor Localization Systems](https://mlsanity.com/paper/1804.05347/) (2018)
- [Multimodal Feature Fusion and Knowledge-Driven Learning via Experts Consult for Thyroid Nodule Classification](https://mlsanity.com/paper/2005.14117/) (2020)
- [Wi2Vi: Generating Video Frames from WiFi CSI Samples](https://mlsanity.com/paper/2001.05842/) (2019)
- [CSI2Image: Image Reconstruction from Channel State Information Using Generative Adversarial Networks](https://mlsanity.com/paper/2009.07100/) (2020)
- [PAC-GAN: An Effective Pose Augmentation Scheme for Unsupervised Cross-View Person Re-identification](https://mlsanity.com/paper/1906.01792/) (2019)

## Built on by (most cited first, 3 of 3)

- [Transformer-Based Person Identification via Wi-Fi CSI Amplitude and Phase Perturbations](https://mlsanity.com/paper/2507.12854/) (2025)
- [Medicinal Boxes Recognition on a Deep Transfer Learning Augmented Reality Mobile Application](https://mlsanity.com/paper/2203.14031/) (2022)
- [WiFi based Human Fall and Activity Recognition using Transformer based Encoder Decoder and Graph Neural Networks](https://mlsanity.com/paper/2504.16655/) (2025)

## Abstract (arXiv)

The increasing availability of wireless access points (APs) is leading towards human sensing applications based on Wi-Fi signals as support or alternative tools to the widespread visual sensors, where the signals enable to address well-known vision-related problems such as illumination changes or occlusions. Indeed, using image synthesis techniques to translate radio frequencies to the visible spectrum can become essential to obtain otherwise unavailable visual data. This domain-to-domain translation is feasible because both objects and people affect electromagnetic waves, causing radio and optical frequencies variations. In literature, models capable of inferring radio-to-visual features mappings have gained momentum in the last few years since frequency changes can be observed in the radio domain through the channel state information (CSI) of Wi-Fi APs, enabling signal-based feature extraction, e.g., amplitude. On this account, this paper presents a novel two-branch generative neural network that effectively maps radio data into visual features, following a teacher-student design that exploits a cross-modality supervision strategy. The latter conditions signal-based features in the visual domain to completely replace visual data. Once trained, the proposed method synthesizes human silhouette and skeleton videos using exclusively Wi-Fi signals. The approach is evaluated on publicly available data, where it obtains remarkable results for both silhouette and skeleton videos generation, demonstrating the effectiveness of the proposed cross-modality supervision strategy.