Towards Robust and Realistic Human Pose Estimation via WiFi Signals
Not on the map. Why?
Abstract (arXiv)
Robust WiFi-based human pose estimation (HPE) is a challenging task that bridges discrete and subtle WiFi signals to human skeletons. We revisit this problem and reveal two critical yet overlooked issues: 1) cross-domain gap, i.e., due to significant discrepancies in pose distributions between source and target domains; and 2) structural fidelity gap, i.e., predicted skeletal poses manifest distorted topology, usually with misplaced joints and disproportionate bone lengths. This paper fills these gaps by reformulating the task into a novel two-phase framework dubbed DT-Pose: Domain-consistent representation learning and Topology-constrained Pose decoding. Concretely, we first propose a temporal consistency contrastive learning strategy with uniformity regularization, integrated into a self-supervised masked pretraining paradigm. This design facilitates robust learning of domain-consistent and motion-discriminative WiFi representations while mitigating potential mode collapse caused by signal sparsity. Beyond this, we introduce an effective hybrid decoding architecture that incorporates explicit skeletal topology constraints. By compensating for the inherent absence of spatial priors in WiFi semantic vectors, the decoder enables structured modeling of both adjacent and overarching joint relationships, producing more realistic pose predictions. Extensive experiments conducted on various benchmark datasets highlight the superior performance of our method in tackling these fundamental challenges in 2D/3D WiFi-based HPE tasks. The associated code is released at https://github.com/cseeyangchen/DT-Pose.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 30 of its 44 references that are in the map. First posted on arXiv 16 Jan 2025.
Builds on
30 of 44 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 516
- 2021Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognitioncited by 317
- 2022Masked Autoencoders that Listencited by 271
- 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 205
- 2022DiffPose: Toward More Reliable 3D Pose Estimationcited by 99
- 2021Exploiting Temporal Contexts with Strided Transformer for 3D Human Pose Estimationcited by 94
- 2021Constructing Stronger and Faster Baselines for Skeleton-based Action Recognitioncited by 87
18 more
- 2023MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensingcited by 77
- 2020Spatial Temporal Transformer Network for Skeleton-based Action Recognitioncited by 76
- 2019Person-in-WiFi: Fine-grained Person Perception using WiFicited by 56
- 2023TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoderscited by 42
- 2023SkeletonMAE: Graph-based Masked Autoencoder for Skeleton Sequence Pre-trainingcited by 41
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 39
- 2016Action Recognition Based on Joint Trajectory Maps Using Convolutional Neural Networkscited by 32
- 2023Group Pose: A Simple Baseline for End-to-End Multi-person Pose Estimationcited by 26
- 2024Diffusion Model is a Good Pose Estimator from 3D RF-Visioncited by 21
- 2019Can WiFi Estimate Person Pose?cited by 19
- 2024Fine-Grained Side Information Guided Dual-Prompts for Zero-Shot Skeleton Action Recognitioncited by 19
- 2022Focal and Global Spatial-Temporal Transformer for Skeleton-based Action Recognitioncited by 18
- 2022AutoFi: Towards Automatic WiFi Human Sensing via Geometric Self-Supervised Learningcited by 15
- 2024Neuron: Learning Context-Aware Evolving Representations for Zero-Shot Skeleton Action Recognitioncited by 13
- 2023AdaPose: Towards Cross-Site Device-Free Human Pose Estimation with Commodity WiFicited by 12
- 2024Vision-Language Meets the Skeleton: Progressively Distillation with Cross-Modal Knowledge for 3D Action Representation Learningcited by 11
- 2020From Point to Space: 3D Moving Human Pose Estimation Using Commodity WiFicited by 10
- 2021Single Person Pose Estimation: A Surveycited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025Graph-based 3D Human Pose Estimation using WiFi Signalscited by 3
- 2026Breaking Coordinate Overfitting: Geometry-Aware WiFi Sensing for Cross-Layout 3D Pose Estimationcited by 2
- 2026WiFi-JEPA: Self-supervised Learning for WiFi-CSI 3D Human Pose Estimationcited by 1
- 2025MultiFormer: A Multi-Person Pose Estimation System Based on CSI and Attention Mechanismcited by 0
- 2026C-MambaPose: A Physics-Informed Complex Mamba Framework for Cross-Environment WiFi Human Pose Estimationcited by 0
- 2026WiFi-JEPA: Self-supervised Learning for WiFi-CSI 3D Human Pose Estimation13 Jul 2026
- 2026C-MambaPose: A Physics-Informed Complex Mamba Framework for Cross-Environment WiFi Human Pose Estimation5 Jun 2026
- 2026Breaking Coordinate Overfitting: Geometry-Aware WiFi Sensing for Cross-Layout 3D Pose Estimation18 Jan 2026
- 2025Graph-based 3D Human Pose Estimation using WiFi Signals24 Nov 2025
- 2025MultiFormer: A Multi-Person Pose Estimation System Based on CSI and Attention Mechanism28 May 2025