# MetaFi: Device-Free Pose Estimation via Commodity WiFi for Metaverse Avatar Simulation

arXiv: https://arxiv.org/abs/2208.10414 · HTML: https://mlsanity.com/paper/2208.10414/

## Key facts

- Cited by 22 papers in the map (data through 14 Oct 2026).
- Builds on 7 of its 39 references that are in the map.
- First posted on arXiv 22 Aug 2022.

## Builds on (most cited first, 7 of 7)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Deep High-Resolution Representation Learning for Human Pose Estimation](https://mlsanity.com/paper/1902.09212/) (2019)
- [OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields](https://mlsanity.com/paper/1812.08008/) (2018)
- [RMPE: Regional Multi-person Pose Estimation](https://mlsanity.com/paper/1612.00137/) (2016)
- [CrowdPose: Efficient Crowded Scenes Pose Estimation and A New Benchmark](https://mlsanity.com/paper/1812.00324/) (2018)
- [All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agenda](https://mlsanity.com/paper/2110.05352/) (2021)
- [Can WiFi Estimate Person Pose?](https://mlsanity.com/paper/1904.00277/) (2019)

## Built on by (most cited first, 22 of 22)

- [MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensing](https://mlsanity.com/paper/2305.10345/) (2023)
- [Diffusion Model is a Good Pose Estimator from 3D RF-Vision](https://mlsanity.com/paper/2403.16198/) (2024)
- [GaitFi: Robust Device-Free Human Identification via WiFi and Vision Multimodal Learning](https://mlsanity.com/paper/2208.14326/) (2022)
- [AdaPose: Towards Cross-Site Device-Free Human Pose Estimation with Commodity WiFi](https://mlsanity.com/paper/2309.16964/) (2023)
- [CSI-BERT2: A BERT-inspired Framework for Efficient CSI Prediction and Classification in Wireless Communication and Sensing](https://mlsanity.com/paper/2412.06861/) (2024)
- [Resource Allocation for Mobile Metaverse with the Internet of Vehicles over 6G Wireless Communications: A Deep Reinforcement Learning Approach](https://mlsanity.com/paper/2209.13425/) (2022)
- [ProbRadarM3F: mmWave Radar based Human Skeletal Pose Estimation with Probability Map Guided Multi-Format Feature Fusion](https://mlsanity.com/paper/2405.05164/) (2024)
- [WiFlexFormer: Efficient WiFi-Based Person-Centric Sensing](https://mlsanity.com/paper/2411.04224/) (2024)
- [Markerless 3D human pose tracking through multiple cameras and AI: Enabling high accuracy, robustness, and real-time performance](https://mlsanity.com/paper/2303.18119/) (2023)
- [Vision-based Semantic Communications for Metaverse Services: A Contest Theoretic Approach](https://mlsanity.com/paper/2308.07618/) (2023)
- [GenHPE: Generative Counterfactuals for 3D Human Pose Estimation with Radio Frequency Signals](https://mlsanity.com/paper/2503.09537/) (2025)
- [Zero-Shot Open-Vocabulary Human Motion Grounding with Test-Time Training](https://mlsanity.com/paper/2511.15379/) (2025)
- [TinySense: Effective CSI Compression for Scalable and Accurate Wi-Fi Sensing](https://mlsanity.com/paper/2601.15838/) (2026)
- [WiFlow: A Lightweight WiFi-based Continuous Human Pose Estimation Network with Spatio-Temporal Feature Decoupling](https://mlsanity.com/paper/2602.08661/) (2026)
- [SAWEC: Sensing-Assisted Wireless Edge Computing](https://mlsanity.com/paper/2402.10021/) (2024)
- [WiFi based Human Fall and Activity Recognition using Transformer based Encoder Decoder and Graph Neural Networks](https://mlsanity.com/paper/2504.16655/) (2025)
- [MultiFormer: A Multi-Person Pose Estimation System Based on CSI and Attention Mechanism](https://mlsanity.com/paper/2505.22555/) (2025)
- [SkeFi: Cross-Modal Knowledge Transfer for Wireless Skeleton-Based Action Recognition](https://mlsanity.com/paper/2601.12432/) (2026)
- [Seeing Through WiFi: Lightweight Human Pose Estimation with Dynamic Kernel Attention](https://mlsanity.com/paper/2607.03196/) (2026)
- [KOALA: Koopman Operator Learning for WiFi-Based Anticipatory Hum](https://mlsanity.com/paper/2608.15815/) (2026)
- [WiFlow: Estimating Optical Flow using WiFi Channel State Information](https://mlsanity.com/paper/2609.02452/) (2026)
- [Structured Pose-Conditioned Flow Matching for Generative 5G CSI Augmentation](https://mlsanity.com/paper/2609.29912/) (2026)

## Abstract (arXiv)

Avatar refers to a representative of a physical user in the virtual world that can engage in different activities and interact with other objects in metaverse. Simulating the avatar requires accurate human pose estimation. Though camera-based solutions yield remarkable performance, they encounter the privacy issue and degraded performance caused by varying illumination, especially in smart home. In this paper, we propose a WiFi-based IoT-enabled human pose estimation scheme for metaverse avatar simulation, namely MetaFi. Specifically, a deep neural network is designed with customized convolutional layers and residual blocks to map the channel state information to human pose landmarks. It is enforced to learn the annotations from the accurate computer vision model, thus achieving cross-modal supervision. WiFi is ubiquitous and robust to illumination, making it a feasible solution for avatar applications in smart home. The experiments are conducted in the real world, and the results show that the MetaFi achieves very high performance with a PCK@50 of 95.23%.