mlsanityData to 14 Oct 2026

AugLift: Depth-Aware Input Reparameterization Improves Domain Generalization in 2D-to-3D Pose Lifting

arXiv 2508.07112 ↗First posted 9 Aug 2025cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Lifting-based 3D human pose estimation infers 3D joints from 2D keypoints but generalizes poorly because (x,y) coordinates alone are an ill-posed, sparse representation that discards geometric information modern foundation models can recover. We propose AugLift, which changes the representation format of lifting from 2D coordinates to a 6D geometric descriptor via two modules: (1) an Uncertainty-Aware Depth Descriptor (UADD) -- a compact tuple (c, d, dmin, dmax) extracted from a confidence-scaled neighborhood of an off-the-shelf monocular depth map -- and (2) a scale normalization component that handles train/test distance shifts. AugLift requires no new sensors, no new data collection, and no architectural changes beyond widening the input layer; because it operates at the representation level, it is composable with any lifting architecture or domain generalization technique. In the detection setting, AugLift reduces cross-dataset MPJPE by 10.1% on average across four datasets and four lifting architectures while improving in-distribution accuracy by 4.0%; post-hoc analysis shows gains concentrate on novel poses and occluded joints. In the ground-truth 2D setting, combining AugLift with PoseAug's differentiable domain generalization achieves state-of-the-art cross-dataset performance (62.4,mm on 3DHP, 92.6,mm on 3DPW; 14.5% and 22.2% over PoseAug), demonstrating that foundation-model depth provides genuine geometric signal complementary to explicit 3D augmentation. Code will be made publicly available.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 9 Aug 2025.

Builds on

19 of 28 references.

References · 19

  1. 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 494
  2. 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 403
  3. 2017A simple yet effective baseline for 3d human pose estimationcited by 401
  4. 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 272
  5. 2016Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Posecited by 221
  6. 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 193
  7. 2018Ordinal Depth Supervision for 3D Human Pose Estimationcited by 107
  8. 2019Unsupervised 3D Pose Estimation with Geometric Self-Supervisioncited by 95
  9. 2019Single-Stage Multi-Person Pose Machinescited by 95
  10. 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimationcited by 89
  11. 2018Unsupervised Geometry-Aware Representation for 3D Human Pose Estimationcited by 73
  12. 2020Predicting Camera Viewpoint Improves Cross-dataset Generalization for 3D Human Pose Estimationcited by 36
7 more
  1. 2023Global Adaptation meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimationcited by 19
  2. 2024A Dual-Augmentor Framework for Domain Generalization in 3D Human Pose Estimationcited by 15
  3. 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimationcited by 11
  4. 2022DH-AUG: DH Forward Kinematics Model Driven Augmentation for 3D Human Pose Estimationcited by 8
  5. 2023Lifting by Image -- Leveraging Image Cues for Accurate 3D Human Pose Estimationcited by 6
  6. 2022PoseGU: 3D Human Pose Estimation with Novel Human Pose Generator and Unbiased Learningcited by 4
  7. 2025PoseBench3D: A Cross-Dataset Analysis Framework for 3D Human Pose Estimation via Pose Lifting Networkscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.