Unsupervised Geometry-Aware Representation for 3D Human Pose Estimation
Not on the map. Why?
Abstract (arXiv)
Modern 3D human pose estimation techniques rely on deep networks, which require large amounts of training data. While weakly-supervised methods require less supervision, by utilizing 2D poses or multi-view imagery without annotations, they still need a sufficiently large set of samples with 3D annotations for learning to succeed. In this paper, we propose to overcome this problem by learning a geometry-aware body representation from multi-view images without annotations. To this end, we use an encoder-decoder that predicts an image from one viewpoint given an image from another viewpoint. Because this representation encodes 3D geometry, using it in a semi-supervised setting makes it easier to learn a mapping from it to 3D human pose. As evidenced by our experiments, our approach significantly outperforms fully-supervised methods given the same amount of labeled data, and improves over other semi-supervised methods while using as little as 1% of the labeled data.
Key facts. Cited by 73 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 23; 2023: 13; 2024: 8; 2025: 3; 2026: 1.
73 papers.
Sort:
By area:
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimationcited by 88
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
- 2021THUNDR: Transformer-based 3D HUmaN Reconstruction with Markerscited by 50
- 2022Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formatscited by 50
- 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 49
- 2022Uplift and Upsample: Efficient 3D Human Pose Estimation with Uplifting Transformerscited by 33
- 2022Equivariant Point Cloud Analysis via Learning Orientations for Message Passingcited by 32
- 2024Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Modelscited by 30
- 2021AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wildcited by 29
38 more
- 2021HSPACE: Synthetic Parametric Humans Animated in Complex Environmentscited by 29
- 2022LAKe-Net: Topology-Aware Point Cloud Completion by Localizing Aligned Keypointscited by 27
- 2022Domain Knowledge-Informed Self-Supervised Representations for Workout Form Assessmentcited by 25
- 2022Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimationcited by 25
- 2022PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervisioncited by 25
- 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDARcited by 23
- 2021BodyPressure -- Inferring Body Pose and Contact Pressure from a Depth Imagecited by 20
- 2021Learning Geometry-Guided Depth via Projective Modeling for Monocular 3D Object Detectioncited by 20
- 2021Intrinsic-Extrinsic Preserved GANs for Unsupervised 3D Pose Transfercited by 20
- 2023Vision-Based Human Pose Estimation via Deep Learning: A Surveycited by 20
- 2021GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generationcited by 19
- 2022MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenescited by 18
- 2022AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypointscited by 17
- 2022Contrastive Representation Learning for Gaze Estimationcited by 14
- 2021MetaPose: Fast 3D Pose from Multiple Views without 3D Supervisioncited by 12
- 2021Self-Supervised 3D Human Pose Estimation with Multiple-View Geometrycited by 10
- 2022On Triangulation as a Form of Self-Supervision for 3D Human Pose Estimationcited by 10
- 2022Self-supervised Human Mesh Recovery with Cross-Representation Alignmentcited by 9
- 2022Progressive Multi-view Human Mesh Recovery with Self-Supervisioncited by 9
- 2024Markerless Multi-view 3D Human Pose Estimation: a surveycited by 9
- 2021Unsupervised Novel View Synthesis from a Single Imagecited by 8
- 2023Self-supervised 3D Human Pose Estimation from a Single Imagecited by 8
- 2023Rethinking Self-Supervised Visual Representation Learning in Pre-training for 3D Human Pose and Shape Estimationcited by 7
- 2023Unsupervised 3D Pose Estimation with Non-Rigid Structure-from-Motion Modelingcited by 7
- 2022Non-Local Latent Relation Distillation for Self-Adaptive 3D Human Pose Estimationcited by 6
- 2022A Light Touch Approach to Teaching Transformers Multi-view Geometrycited by 6
- 2023Few-shot Geometry-Aware Keypoint Localizationcited by 6
- 2021Semi-supervised Viewpoint Estimation with Geometry-aware Conditional Generationcited by 5
- 2022Enhancing Egocentric 3D Pose Estimation with Third Person Viewscited by 5
- 2022TUSK: Task-Agnostic Unsupervised Keypointscited by 5
- 2023Human Body Pose Estimation for Gait Identification: A Comprehensive Survey of Datasets and Modelscited by 5
- 2021PoseKernelLifter: Metric Lifting of 3D Human Pose using Soundcited by 4
- 2022Estimating Pose from Pressure Data for Smart Beds with Deep Image-based Pose Estimatorscited by 4
- 2021Heuristic Weakly Supervised 3D Human Pose Estimationcited by 3
- 2021SVMAC: Unsupervised 3D Human Pose Estimation from a Single Image with Single-view-multi-angle Consistencycited by 3
- 2021Unsupervised View-Invariant Human Posture Representationcited by 3
- 2022ViewNet: Unsupervised Viewpoint Estimation from Conditional Generationcited by 3
- 2021Disentangling Geometric Deformation Spaces in Generative Latent Shape Modelscited by 2
50 most cited of 73 All 73 (JSON)
- 2026CrossVL: Complexity-Aware Feature Routing and Paired Curriculum for Cross-View Vision-Language Detection10 May 2026
- 2025AugLift: Depth-Aware Input Reparameterization Improves Domain Generalization in 2D-to-3D Pose Lifting9 Aug 2025
- 2025Disentangled Human Body Representation Based on Unsupervised Semantic-Aware Learning25 May 2025
- 2025DreamTexture: Shape from Virtual Texture with Analysis by Augmentation20 Mar 2025
- 2024Markerless Multi-view 3D Human Pose Estimation: a survey4 Jul 2024
- 2024EPOCH: Jointly Estimating the 3D Pose of Cameras and Humans28 Jun 2024
- 2024Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Models13 Jun 2024
- 2024DifAttack++: Query-Efficient Black-Box Adversarial Attack via Hierarchical Disentangled Feature Space in Cross-Domain5 Jun 2024
- 2024Semi-Supervised Unconstrained Head Pose Estimation in the Wild3 Apr 2024
- 2024Self-learning Canonical Space for Multi-view 3D Human Pose Estimation19 Mar 2024
- 2024Occlusion Resilient 3D Human Pose Estimation16 Feb 2024
- 2024Using Motion Cues to Supervise Single-Frame Body Pose and Shape Estimation in Low Data Regimes5 Feb 2024
38 more
- 2023RSB-Pose: Robust Short-Baseline Binocular 3D Human Pose Estimation with Occlusion Handling24 Nov 2023
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformers16 Oct 2023
- 20233DHR-Co: A Collaborative Test-time Refinement Framework for In-the-Wild 3D Human-Body Reconstruction Task2 Oct 2023
- 2023Understanding Pose and Appearance Disentanglement in 3D Human Pose Estimation20 Sep 2023
- 2023Mirror-Aware Neural Humans9 Sep 2023
- 2023Vision-Based Human Pose Estimation via Deep Learning: A Survey26 Aug 2023
- 2023Unsupervised 3D Pose Estimation with Non-Rigid Structure-from-Motion Modeling18 Aug 2023
- 2023Human Body Pose Estimation for Gait Identification: A Comprehensive Survey of Datasets and Models23 May 2023
- 2023Unsupervised Style-based Explicit 3D Face Reconstruction from Single Image24 Apr 2023
- 2023Self-supervised 3D Human Pose Estimation from a Single Image5 Apr 2023
- 2023Few-shot Geometry-Aware Keypoint Localization30 Mar 2023
- 2023Novel View Synthesis of Humans using Differentiable Rendering28 Mar 2023
- 2023Rethinking Self-Supervised Visual Representation Learning in Pre-training for 3D Human Pose and Shape Estimation9 Mar 2023
- 2022Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formats29 Dec 2022
- 2022Progressive Multi-view Human Mesh Recovery with Self-Supervision10 Dec 2022
- 2022ViewNet: Unsupervised Viewpoint Estimation from Conditional Generation1 Dec 2022
- 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDAR30 Nov 2022
- 2022A Light Touch Approach to Teaching Transformers Multi-view Geometry28 Nov 2022
- 2022Unsupervised 3D Keypoint Discovery with Multi-View Geometry23 Nov 2022
- 2022Contrastive Representation Learning for Gaze Estimation24 Oct 2022
- 2022Uplift and Upsample: Efficient 3D Human Pose Estimation with Uplifting Transformers12 Oct 2022
- 2022Self-Supervised 3D Human Pose Estimation in Static Video Via Neural Rendering10 Oct 2022
- 2022Self-supervised Human Mesh Recovery with Cross-Representation Alignment10 Sep 2022
- 2022MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenes17 Aug 2022
- 2022TUSK: Task-Agnostic Unsupervised Keypoints16 Jun 2022
- 2022Estimating Pose from Pressure Data for Smart Beds with Deep Image-based Pose Estimators13 Jun 2022
- 2022AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypoints21 May 2022
- 2022Non-Local Latent Relation Distillation for Self-Adaptive 3D Human Pose Estimation5 Apr 2022
- 2022LAKe-Net: Topology-Aware Point Cloud Completion by Localizing Aligned Keypoints31 Mar 2022
- 2022On Triangulation as a Form of Self-Supervision for 3D Human Pose Estimation29 Mar 2022
- 2022PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervision29 Mar 2022
- 2022Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimation29 Mar 2022
- 2022Equivariant Point Cloud Analysis via Learning Orientations for Message Passing28 Mar 2022
- 2022Recovering 3D Human Mesh from Monocular Images: A Survey3 Mar 2022
- 2022Domain Knowledge-Informed Self-Supervised Representations for Workout Form Assessment28 Feb 2022
- 2022Enhancing Egocentric 3D Pose Estimation with Third Person Views6 Jan 2022
- 2021HSPACE: Synthetic Parametric Humans Animated in Complex Environments23 Dec 2021
- 2021GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generation2 Dec 2021
50 newest of 73 All 73 (JSON)
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimationcited by 88
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
- 2021THUNDR: Transformer-based 3D HUmaN Reconstruction with Markerscited by 50
- 2022Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formatscited by 50
- 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 49
- 2022Uplift and Upsample: Efficient 3D Human Pose Estimation with Uplifting Transformerscited by 33
- 2022Equivariant Point Cloud Analysis via Learning Orientations for Message Passingcited by 32
- 2021AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wildcited by 29
- 2021HSPACE: Synthetic Parametric Humans Animated in Complex Environmentscited by 29
12 most cited of 71 All 71 (JSON)
- 2025AugLift: Depth-Aware Input Reparameterization Improves Domain Generalization in 2D-to-3D Pose Lifting9 Aug 2025
- 2025Disentangled Human Body Representation Based on Unsupervised Semantic-Aware Learning25 May 2025
- 2025DreamTexture: Shape from Virtual Texture with Analysis by Augmentation20 Mar 2025
- 2024Markerless Multi-view 3D Human Pose Estimation: a survey4 Jul 2024
- 2024EPOCH: Jointly Estimating the 3D Pose of Cameras and Humans28 Jun 2024
- 2024DifAttack++: Query-Efficient Black-Box Adversarial Attack via Hierarchical Disentangled Feature Space in Cross-Domain5 Jun 2024
- 2024Semi-Supervised Unconstrained Head Pose Estimation in the Wild3 Apr 2024
- 2024Self-learning Canonical Space for Multi-view 3D Human Pose Estimation19 Mar 2024
- 2024Occlusion Resilient 3D Human Pose Estimation16 Feb 2024
- 2024Using Motion Cues to Supervise Single-Frame Body Pose and Shape Estimation in Low Data Regimes5 Feb 2024
- 2023RSB-Pose: Robust Short-Baseline Binocular 3D Human Pose Estimation with Occlusion Handling24 Nov 2023
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformers16 Oct 2023
12 newest of 71 All 71 (JSON)