Predicting Camera Viewpoint Improves Cross-dataset Generalization for 3D Human Pose Estimation
Not on the map. Why?
Abstract (arXiv)
Monocular estimation of 3d human pose has attracted increased attention with the availability of large ground-truth motion capture datasets. However, the diversity of training data available is limited and it is not clear to what extent methods generalize outside the specific datasets they are trained on. In this work we carry out a systematic study of the diversity and biases present in specific datasets and its effect on cross-dataset generalization across a compendium of 5 pose datasets. We specifically focus on systematic differences in the distribution of camera viewpoints relative to a body-centered coordinate frame. Based on this observation, we propose an auxiliary task of predicting the camera viewpoint in addition to pose. We find that models trained to jointly predict viewpoint and pose systematically show significantly improved cross-dataset generalization.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 9; 2023: 5; 2024: 3; 2025: 6.
36 papers.
Sort:
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
- 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimationcited by 88
- 2021AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentationcited by 48
- 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 40
- 2021Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstructioncited by 39
- 2021TransFusion: Cross-view Fusion with Transformer for 3D Human Pose Estimationcited by 32
- 2021AdaptPose: Cross-Dataset Adaptation for 3D Human Pose Estimation by Learnable Motion Generationcited by 32
- 2022HULC: 3D Human Motion Capture with Pose Manifold Sampling and Dense Contact Guidancecited by 29
- 2022PPT: token-Pruned Pose Transformer for monocular and multi-view human pose estimationcited by 27
- 2021PC-HMR: Pose Calibration for 3D Human Mesh Recovery from 2D Images/Videoscited by 25
- 2022Ray3D: ray-based 3D human pose estimation for monocular absolute 3D localizationcited by 25
- 2022PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervisioncited by 25
24 more
- 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptationcited by 24
- 2021Adaptive Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimationcited by 19
- 2023Global Adaptation meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimationcited by 19
- 2021SSCAP: Self-supervised Co-occurrence Action Parsing for Unsupervised Temporal Action Segmentationcited by 15
- 2021MetaPose: Fast 3D Pose from Multiple Views without 3D Supervisioncited by 12
- 2022Identity-Aware Hand Mesh Estimation and Personalization from RGB Imagescited by 11
- 2022The Best of Both Worlds: Combining Model-based and Nonparametric Approaches for 3D Human Body Estimationcited by 8
- 2022Weakly-supervised Pre-training for 3D Human Pose Estimation via Perspective Knowledgecited by 6
- 2021PoseKernelLifter: Metric Lifting of 3D Human Pose using Soundcited by 4
- 2022PoseGU: 3D Human Pose Estimation with Novel Human Pose Generator and Unbiased Learningcited by 4
- 2021Learning Local Recurrent Models for Human Mesh Recoverycited by 3
- 2024Uncertainty-Aware Testing-Time Optimization for 3D Human Pose Estimationcited by 2
- 2025PoseBench3D: A Cross-Dataset Analysis Framework for 3D Human Pose Estimation via Pose Lifting Networkscited by 2
- 2025PersPose: 3D Human Pose Estimation with Perspective Encoding and Perspective Rotationcited by 2
- 2022Decanus to Legatus: Synthetic training for 2D-3D human pose liftingcited by 1
- 2023SoloPose: One-Shot Kinematic 3D Human Pose Estimation with Video Data Augmentationcited by 1
- 2024ESCAPE: Energy-based Selective Adaptive Correction for Out-of-distribution 3D Human Pose Estimationcited by 1
- 2025Unsupervised Cross-Domain 3D Human Pose Estimation via Pseudo-Label-Guided Global Transformscited by 1
- 2023Distilling Token-Pruned Pose Transformer for 2D Human Pose Estimationcited by 0
- 2023Learning from Abstract Images: on the Importance of Occlusion in a Minimalist Encoding of Human Posescited by 0
- 2023Improved TokenPose with Sparsitycited by 0
- 2025Leveraging 2D Masked Reconstruction for Domain Adaptation of 3D Pose Estimationcited by 0
- 2025Toward Efficient Generalization in 3D Human Pose Estimation via a Canonical Domain Approachcited by 0
- 2025AugLift: Depth-Aware Input Reparameterization Improves Domain Generalization in 2D-to-3D Pose Liftingcited by 0
- 2025PersPose: 3D Human Pose Estimation with Perspective Encoding and Perspective Rotation24 Aug 2025
- 2025AugLift: Depth-Aware Input Reparameterization Improves Domain Generalization in 2D-to-3D Pose Lifting9 Aug 2025
- 2025PoseBench3D: A Cross-Dataset Analysis Framework for 3D Human Pose Estimation via Pose Lifting Networks16 May 2025
- 2025Unsupervised Cross-Domain 3D Human Pose Estimation via Pseudo-Label-Guided Global Transforms17 Apr 2025
- 2025Toward Efficient Generalization in 3D Human Pose Estimation via a Canonical Domain Approach27 Jan 2025
- 2025Leveraging 2D Masked Reconstruction for Domain Adaptation of 3D Pose Estimation14 Jan 2025
- 2024ESCAPE: Energy-based Selective Adaptive Correction for Out-of-distribution 3D Human Pose Estimation19 Jul 2024
- 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangement27 Jun 2024
- 2024Uncertainty-Aware Testing-Time Optimization for 3D Human Pose Estimation4 Feb 2024
- 2023SoloPose: One-Shot Kinematic 3D Human Pose Estimation with Video Data Augmentation15 Dec 2023
- 2023Improved TokenPose with Sparsity16 Nov 2023
- 2023Learning from Abstract Images: on the Importance of Occlusion in a Minimalist Encoding of Human Poses19 Jul 2023
24 more
- 2023Distilling Token-Pruned Pose Transformer for 2D Human Pose Estimation12 Apr 2023
- 2023Global Adaptation meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimation29 Mar 2023
- 2022Weakly-supervised Pre-training for 3D Human Pose Estimation via Perspective Knowledge22 Nov 2022
- 2022Decanus to Legatus: Synthetic training for 2D-3D human pose lifting5 Oct 2022
- 2022Identity-Aware Hand Mesh Estimation and Personalization from RGB Images22 Sep 2022
- 2022PPT: token-Pruned Pose Transformer for monocular and multi-view human pose estimation16 Sep 2022
- 2022PoseGU: 3D Human Pose Estimation with Novel Human Pose Generator and Unbiased Learning7 Jul 2022
- 2022HULC: 3D Human Motion Capture with Pose Manifold Sampling and Dense Contact Guidance11 May 2022
- 2022The Best of Both Worlds: Combining Model-based and Nonparametric Approaches for 3D Human Body Estimation1 May 2022
- 2022PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervision29 Mar 2022
- 2022Ray3D: ray-based 3D human pose estimation for monocular absolute 3D localization22 Mar 2022
- 2021AdaptPose: Cross-Dataset Adaptation for 3D Human Pose Estimation by Learnable Motion Generation22 Dec 2021
- 2021PoseKernelLifter: Metric Lifting of 3D Human Pose using Sound1 Dec 2021
- 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptation7 Nov 2021
- 2021AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentation20 Oct 2021
- 2021TransFusion: Cross-view Fusion with Transformer for 3D Human Pose Estimation18 Oct 2021
- 2021Adaptive Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimation11 Oct 2021
- 2021SPEC: Seeing People in the Wild with an Estimated Camera1 Oct 2021
- 2021MetaPose: Fast 3D Pose from Multiple Views without 3D Supervision10 Aug 2021
- 2021Learning Local Recurrent Models for Human Mesh Recovery27 Jul 2021
- 2021SSCAP: Self-supervised Co-occurrence Action Parsing for Unsupervised Temporal Action Segmentation29 May 2021
- 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimation6 May 2021
- 2021Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstruction30 Mar 2021
- 2021PC-HMR: Pose Calibration for 3D Human Mesh Recovery from 2D Images/Videos16 Mar 2021
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
- 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimationcited by 88
- 2021AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentationcited by 48
- 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 40
- 2021Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstructioncited by 39
- 2021TransFusion: Cross-view Fusion with Transformer for 3D Human Pose Estimationcited by 32
- 2021AdaptPose: Cross-Dataset Adaptation for 3D Human Pose Estimation by Learnable Motion Generationcited by 32
- 2022HULC: 3D Human Motion Capture with Pose Manifold Sampling and Dense Contact Guidancecited by 29
- 2022PPT: token-Pruned Pose Transformer for monocular and multi-view human pose estimationcited by 27
- 2021PC-HMR: Pose Calibration for 3D Human Mesh Recovery from 2D Images/Videoscited by 25
- 2022Ray3D: ray-based 3D human pose estimation for monocular absolute 3D localizationcited by 25
- 2022PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervisioncited by 25
12 most cited of 36 All 36 (JSON)
- 2025PersPose: 3D Human Pose Estimation with Perspective Encoding and Perspective Rotation24 Aug 2025
- 2025AugLift: Depth-Aware Input Reparameterization Improves Domain Generalization in 2D-to-3D Pose Lifting9 Aug 2025
- 2025PoseBench3D: A Cross-Dataset Analysis Framework for 3D Human Pose Estimation via Pose Lifting Networks16 May 2025
- 2025Unsupervised Cross-Domain 3D Human Pose Estimation via Pseudo-Label-Guided Global Transforms17 Apr 2025
- 2025Toward Efficient Generalization in 3D Human Pose Estimation via a Canonical Domain Approach27 Jan 2025
- 2025Leveraging 2D Masked Reconstruction for Domain Adaptation of 3D Pose Estimation14 Jan 2025
- 2024ESCAPE: Energy-based Selective Adaptive Correction for Out-of-distribution 3D Human Pose Estimation19 Jul 2024
- 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangement27 Jun 2024
- 2024Uncertainty-Aware Testing-Time Optimization for 3D Human Pose Estimation4 Feb 2024
- 2023SoloPose: One-Shot Kinematic 3D Human Pose Estimation with Video Data Augmentation15 Dec 2023
- 2023Improved TokenPose with Sparsity16 Nov 2023
- 2023Learning from Abstract Images: on the Importance of Occlusion in a Minimalist Encoding of Human Poses19 Jul 2023
12 newest of 36 All 36 (JSON)