RAPTR: Radar-based 3D Pose Estimation using Transformer
Not on the map. Why?
Abstract (arXiv)
Radar-based indoor 3D human pose estimation typically relied on fine-grained 3D keypoint labels, which are costly to obtain especially in complex indoor settings involving clutter, occlusions, or multiple people. In this paper, we propose RAPTR (RAdar Pose esTimation using tRansformer) under weak supervision, using only 3D BBox and 2D keypoint labels which are considerably easier and more scalable to collect. Our RAPTR is characterized by a two-stage pose decoder architecture with a pseudo-3D deformable attention to enhance (pose/joint) queries with multi-view radar features: a pose decoder estimates initial 3D poses with a 3D template loss designed to utilize the 3D BBox labels and mitigate depth ambiguities; and a joint decoder refines the initial poses with 2D keypoint labels and a 3D gravity loss. Evaluated on two indoor radar datasets, RAPTR outperforms existing methods, reducing joint position error by 34.3% on HIBER and 76.9% on MMVR. Our implementation is available at https://github.com/merlresearch/radar-pose-transformer.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 51 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
34 of 51 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2017Mask R-CNNcited by 7,259
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
- 2017A simple yet effective baseline for 3d human pose estimationcited by 401
- 2019HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimationcited by 247
- 2019Distribution-Aware Coordinate Representation for Human Pose Estimationcited by 165
22 more
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 20163D Human Pose Estimation = 2D Pose Estimation + Matchingcited by 112
- 2019Unsupervised 3D Pose Estimation with Geometric Self-Supervisioncited by 95
- 2023MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensingcited by 77
- 2017Lifting from the Deep: Convolutional 3D Pose Estimation from a Single Imagecited by 73
- 2020Rethinking the Heatmap Regression for Bottom-up Human Pose Estimationcited by 69
- 2019mm-Pose: Real-Time Human Skeletal Posture Estimation using mmWave Radars and CNNscited by 58
- 2022mRI: Multi-modal 3D Human Pose Estimation Dataset using mmWave, RGB-D, and Inertial Sensorscited by 37
- 2019See Through Smoke: Robust Indoor Mapping with Low-cost mmWave Radarcited by 35
- 2022HuPR: A Benchmark for Human Pose Estimation Using Millimeter Wave Radarcited by 31
- 2023Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Reviewcited by 22
- 2024Diffusion Model is a Good Pose Estimator from 3D RF-Visioncited by 21
- 2023milliFlow: Scene Flow Estimation on mmWave Radar Point Cloud for Human Motion Sensingcited by 20
- 2021CubeLearn: End-to-end Learning for Human Motion Recognition from Raw mmWave Radar Signalscited by 17
- 2024RT-Pose: A 4D Radar Tensor-based 3D Human Pose Estimation and Localization Benchmarkcited by 16
- 2022RFMask: A Simple Baseline for Human Silhouette Segmentation with Radio Signalscited by 13
- 2022Jointformer: Single-Frame Lifting Transformer with Error Prediction and Refinement for 3D Human Pose Estimationcited by 10
- 2024MMVR: Millimeter-wave Multi-View Radar Dataset and Benchmark for Indoor Perceptioncited by 10
- 2023MMBaT: A Multi-task Framework for mmWave-based Human Body Reconstruction and Translation Predictioncited by 7
- 2024RETR: Multi-View Radar Detection Transformer for Indoor Perceptioncited by 6
- 2025mmDEAR: mmWave Point Cloud Density Enhancement for Accurate Human Body Reconstructioncited by 5
- 20244D Radar Semantic Segmentation of People in Field Conditions Using Temporal Multi-View Networkscited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.