mlsanityData to 14 Oct 2026

Privacy-Preserving Full-Body Meshing from mmWave Radar via Mesh Foundation Model Supervision

arXiv 2609.34768 ↗First posted 28 Sep 2026cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Millimeter-wave (mmWave) radar enables privacy-preserving human perception, but the extreme sparsity of point clouds from commercial single-chip sensors (mean ~6.5 points/frame; ~28% empty frames) has confined prior art to body-part keypoints or discrete action classification. We present a cross-modal teacher-student framework that lifts commercial radar to full-body, per-frame, metric 3D mesh reconstruction with per-joint uncertainty. Three innovations: (1) a mesh-foundation-model teacher - SAM 3D Body produces whole-body MHR ground truth (70 joints, 18,439 mesh vertices) from a single RGB frame with zero training, slashing annotation cost by orders of magnitude; (2) StudentPoseFormer - set encoding with masked attention pooling, a temporal Transformer, and a CVAE multi-hypothesis head that outputs both the pose mean and per-joint variance, honestly reporting where the radar cannot see; and (3) a multi-stage ground-truth quality pipeline (confidence gating, depth validation, temporal smoothing, bone-length consistency, bad-frame rejection) plus systematic information-lever ablations. On the public MM-Fi benchmark (same TI IWR6843 sensor, cross-subject), our full configuration reaches 7.45 cm 12-joint MPJPE, with ablations proving the causal value of point accumulation (k = 3, -0.34 cm), Doppler (-0.85 cm; -2 cm at the wrist on fast actions), and velocity loss (-0.27 cm). On our own synchronized radar + RGB-D corpus with block-level held-out splits, the pipeline achieves 21.47 cm end-to-end (per-joint hierarchy from 4.8 cm at the hip to 34.7 cm at the wrist - matching physical information limits), could be improved to 15 cm with ~30k diverse samples, and a scaling law shows sample diversity, not volume, is the binding constraint. Deployment inference is radar-only - no camera, no image.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 12 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

4 of 12 references.

References · 4

  1. 2023MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensingcited by 79
  2. 2026SAM 3D Body: Robust Full-Body Human Mesh Recoverycited by 69
  3. 2019mm-Pose: Real-Time Human Skeletal Posture Estimation using mmWave Radars and CNNscited by 59
  4. 2022Interacting Hand-Object Pose Estimation via Dense Mutual Attentioncited by 22

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Two-Stage Motion-Aware Framework for mmWave-based Human Mesh Recovery
  2. 2026mmHRI: Towards Privacy-Preserving Human-Robot Interaction with Millimeter-Wave Radar
  3. 2026Sim2Radar: Toward Bridging the Radar Sim-to-Real Gap with VLM-Guided Scene Reconstruction
  4. 2025RaLD: Generating High-Resolution 3D Radar Point Clouds with Latent Diffusion
  5. 2026RadarTwin: Scene-Specific mmWave Radar Simulation and Learning for Mobile Indoor Perception
  6. 2026Teaching Foundation Models to Read mmWave: Pose-Guided Kinematic Representation for Human Behavior Understanding
  7. 2026DiFF: Doppler-informed Flow Matching for Human Motion Flow
  8. 2026Kinematics-Induced Multimodal 3D Human Pose Estimation with Subject-Level Privacy