mlsanityData to 14 Oct 2026

Human Pose and Shape Estimation from Single Polarization Images

arXiv 2108.06834 ↗First posted 15 Aug 2021cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

This paper focuses on a new problem of estimating human pose and shape from single polarization images. Polarization camera is known to be able to capture the polarization of reflected lights that preserves rich geometric cues of an object surface. Inspired by the recent applications in surface normal reconstruction from polarization images, in this paper, we attempt to estimate human pose and shape from single polarization images by leveraging the polarization-induced geometric cues. A dedicated two-stage pipeline is proposed: given a single polarization image, stage one (Polar2Normal) focuses on the fine detailed human body surface normal estimation; stage two (Polar2Shape) then reconstructs clothed human shape from the polarization image and the estimated surface normal. To empirically validate our approach, a dedicated dataset (PHSPD) is constructed, consisting of over 500K frames with accurate pose and parametric shape annotations. Empirical evaluations on this real-world dataset as well as a synthetic dataset, SURREAL, demonstrate the effectiveness of our approach. It suggests polarization camera as a promising alternative to the more conventional RGB camera for human pose and shape estimation.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 44 of its 79 references that are in the map. First posted on arXiv 15 Aug 2021.

Builds on

44 of 79 references.

References · 44

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  5. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
  6. 2017End-to-end Recovery of Human Shape and Posecited by 885
  7. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  8. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
  9. 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
  10. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
  11. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  12. 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 494
32 more
  1. 2017A simple yet effective baseline for 3d human pose estimationcited by 401
  2. 2017Learning from Synthetic Humanscited by 359
  3. 2018Learning 3D Human Dynamics from Videocited by 316
  4. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
  5. 2018Learning to Estimate 3D Human Pose and Shape from a Single Color Imagecited by 226
  6. 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
  7. 2018Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimationcited by 185
  8. 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
  9. 2017PoseTrack: A Benchmark for Human Pose Estimation and Trackingcited by 173
  10. 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
  11. 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
  12. 2017Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approachcited by 115
  13. 2018Ordinal Depth Supervision for 3D Human Pose Estimationcited by 107
  14. 2019DenseRaC: Joint 3D Pose and Shape Estimation by Dense Render-and-Comparecited by 100
  15. 20183D Human Pose Estimation in the Wild by Adversarial Learningcited by 86
  16. 2019RepNet: Weakly Supervised Training of an Adversarial Reprojection Network for 3D Human Pose Estimationcited by 85
  17. 2017Lifting from the Deep: Convolutional 3D Pose Estimation from a Single Imagecited by 73
  18. 2021S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modelingcited by 59
  19. 2015Sparseness Meets Deepness: 3D Human Pose Estimation from Monocular Videocited by 54
  20. 2019In the Wild Human Pose Estimation Using Explicit 2D Features and Intermediate 3D Representationscited by 48
  21. 2018A Progressive Batching L-BFGS Method for Machine Learningcited by 45
  22. 2015Maximum-Margin Structured Learning with Deep Networks for 3D Human Pose Estimationcited by 37
  23. 20163D Human Pose Estimation Using Convolutional Neural Networks with 2D Pose Informationcited by 28
  24. 20203D Human Shape Reconstruction from a Polarization Imagecited by 28
  25. 2014Robust Estimation of 3D Human Poses from a Single Imagecited by 23
  26. 2019A Neural Network for Detailed Human Depth Estimation from a Single Imagecited by 21
  27. 2017Knowledge-Guided Deep Fractal Neural Networks for Human Pose Estimationcited by 18
  28. 20193D Human Pose Machines with Self-supervised Learningcited by 17
  29. 2020SparseFusion: Dynamic Human Avatar Modeling from Sparse RGBD Imagescited by 16
  30. 2021Detailed Avatar Recovery from Single Imagecited by 16
  31. 2018DRPose3D: Depth Ranking in 3D Human Pose Estimationcited by 9
  32. 2016A Simple, Fast and Highly-Accurate Algorithm to Recover 3D Shape from 2D Landmarks on a Single Imagecited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 5; 2024: 4; 2025: 0; 2026: 2.

13 papers.

Sort:

By area:

  1. 2023NeISF: Neural Incident Stokes Field for Geometry and Material Estimationcited by 25
  2. 2022Transparent Shape from a Single View Polarization Imagecited by 16
  3. 2023LiDAR-HMR: 3D Human Mesh Recovery from LiDARcited by 12
  4. 2024Deep learning for 3D human pose estimation and mesh recovery: A surveycited by 11
  5. 2023Highly Efficient 3D Human Pose Tracking from Events with Spiking Spatiotemporal Transformercited by 10
  6. 2022Snipper: A Spatiotemporal Transformer for Simultaneous Multi-Person 3D Pose Estimation Tracking and Forecasting on a Video Snippetcited by 6
  7. 2024Deep Polarization Cues for Single-shot Shape and Subsurface Scattering Estimationcited by 6
  8. 2023Fooling Polarization-based Vision using Locally Controllable Polarizing Projectioncited by 2
  9. 2023Pola4All: survey of polarimetric applications and an open-source toolkit to analyze polarizationcited by 1
  10. 2024Cross-Domain Knowledge Distillation for Low-Resolution Human Pose Estimationcited by 0
  11. 2024Video Frame Interpolation for Polarization via Swin-Transformercited by 0
  12. 2026Generative Data Augmentation for Skeleton Action Recognitioncited by 0
1 more
  1. 2026Human4K: A Large-Scale 4K Multi-View Mocap Dataset for Whole-Body 3D Human Reconstructioncited by 0