Generalizable Human Pose Triangulation
Not on the map. Why?
Abstract (arXiv)
We address the problem of generalizability for multi-view 3D human pose estimation. The standard approach is to first detect 2D keypoints in images and then apply triangulation from multiple views. Even though the existing methods achieve remarkably accurate 3D pose estimation on public benchmarks, most of them are limited to a single spatial camera arrangement and their number. Several methods address this limitation but demonstrate significantly degraded performance on novel views. We propose a stochastic framework for human pose triangulation and demonstrate a superior generalization across different camera arrangements on two public datasets. In addition, we apply the same approach to the fundamental matrix estimation problem, showing that the proposed method can successfully apply to other computer vision problems. The stochastic framework achieves more than 8.8% improvement on the 3D pose estimation task, compared to the state-of-the-art, and more than 30% improvement for fundamental matrix estimation, compared to a standard algorithm.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 26 of its 42 references that are in the map. First posted on arXiv 1 Oct 2021.
Builds on
26 of 42 references.
References · 26
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
- 2016Convolutional Pose Machinescited by 325
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
- 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
- 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
- 2017Learning to Find Good Correspondencescited by 176
- 2016Panoptic Studio: A Massively Multiview System for Social Interaction Capturecited by 173
- 2018Monocular Total Capture: Posing Face, Body, and Hands in the Wildcited by 162
- 2019Learnable Triangulation of Human Posecited by 160
14 more
- 2014A* Samplingcited by 150
- 2017Learning Less is More - 6D Camera Localization via 3D Surface Regressioncited by 146
- 2019Neural-Guided RANSAC: Learning Where to Sample Model Hypothesescited by 129
- 2015Gradient Estimation Using Stochastic Computation Graphscited by 120
- 2020Epipolar Transformerscited by 117
- 2019Self-Supervised Learning of 3D Human Pose using Multi-view Geometrycited by 98
- 2019Cross View Fusion for 3D Human Pose Estimationcited by 90
- 2020Lightweight Multi-View 3D Pose Estimation through Camera-Disentangled Representationcited by 57
- 2019View-Invariant Probabilistic Embedding for Human Posecited by 47
- 2018Can 3D Pose be Learned from 2D Projections Alone?cited by 44
- 2018A generalizable approach for multi-view 3D human pose regressioncited by 26
- 2018Rethinking Pose in 3D: Multi-stage Refinement and Recovery for Markerless Motion Capturecited by 17
- 2021Real-Time Multi-View 3D Human Pose Estimation using Semantic Feedback to Smart Edge Sensorscited by 16
- 2021Self-Supervised 3D Human Pose Estimation with Multiple-View Geometrycited by 10
Built on by
Citing papers per year: 2022: 3; 2023: 6; 2024: 4; 2025: 6; 2026: 5.
24 papers.
Sort:
- 2023AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimationcited by 64
- 2023Ego3DPose: Capturing 3D Cues from Binocular Egocentric Viewscited by 22
- 2023Multiple View Geometry Transformers for 3D Human Pose Estimationcited by 19
- 2022Efficient Annotation and Learning for 3D Hand Pose Estimation: A Surveycited by 17
- 2023Novel-view Synthesis and Pose Estimation for Hand-Object Interaction from Sparse Viewscited by 16
- 2022Progressive Multi-view Human Mesh Recovery with Self-Supervisioncited by 9
- 2024Markerless Multi-view 3D Human Pose Estimation: a surveycited by 9
- 2025MV-SSM: Multi-View State Space Modeling for 3D Human Pose Estimationcited by 9
- 2023HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learningcited by 7
- 2023Probabilistic Triangulation for Uncalibrated Multi-View 3D Human Pose Estimationcited by 7
- 2024UPose3D: Uncertainty-Aware 3D Human Pose Estimation with Cross-View and Temporal Cuescited by 6
- 2024VoxelKeypointFusion: Generalizable Multi-View Multi-Person Pose Estimationcited by 3
12 more
- 2022Multi-person 3D pose estimation from unlabelled datacited by 2
- 2025Pose Splatter: A 3D Gaussian Splatting Model for Quantifying Animal Pose and Appearancecited by 2
- 2025RUMPL: Ray-Based Transformers for Universal Multi-View 2D to 3D Human Pose Liftingcited by 2
- 2026COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimationcited by 1
- 2026Unconstrained Multi-view Human Pose Estimation with Algebraic Priorscited by 1
- 2024Marker-free Human Gait Analysis using a Smart Edge Sensor Systemcited by 0
- 2025DeProPose: Deficiency-Proof 3D Human Pose Estimation via Adaptive Multi-View Fusioncited by 0
- 2025TrackStudio: An Integrated Toolkit for Markerless Trackingcited by 0
- 2025SkelSplat: Robust Multi-view 3D Human Pose Estimation with Differentiable Gaussian Renderingcited by 0
- 2026Human Pose Estimation in Trampoline Gymnastics: How to Improve Performance on Extreme Posescited by 0
- 2026Mesh-Aware Epipolar Matching for Multi-View Multi-Person 3D Pose Estimation in Basketballcited by 0
- 2026HandMvNet: Real-Time 3D Hand Pose Estimation Using Multi-View Cross-Attention Fusioncited by 0
- 2026HandMvNet: Real-Time 3D Hand Pose Estimation Using Multi-View Cross-Attention Fusion20 Aug 2026
- 2026Mesh-Aware Epipolar Matching for Multi-View Multi-Person 3D Pose Estimation in Basketball28 May 2026
- 2026Unconstrained Multi-view Human Pose Estimation with Algebraic Priors27 Apr 2026
- 2026Human Pose Estimation in Trampoline Gymnastics: How to Improve Performance on Extreme Poses1 Apr 2026
- 2026COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimation14 Jan 2026
- 2025RUMPL: Ray-Based Transformers for Universal Multi-View 2D to 3D Human Pose Lifting17 Dec 2025
- 2025SkelSplat: Robust Multi-view 3D Human Pose Estimation with Differentiable Gaussian Rendering11 Nov 2025
- 2025TrackStudio: An Integrated Toolkit for Markerless Tracking10 Nov 2025
- 2025MV-SSM: Multi-View State Space Modeling for 3D Human Pose Estimation31 Aug 2025
- 2025Pose Splatter: A 3D Gaussian Splatting Model for Quantifying Animal Pose and Appearance23 May 2025
- 2025DeProPose: Deficiency-Proof 3D Human Pose Estimation via Adaptive Multi-View Fusion23 Feb 2025
- 2024Marker-free Human Gait Analysis using a Smart Edge Sensor System14 Nov 2024
12 more
- 2024VoxelKeypointFusion: Generalizable Multi-View Multi-Person Pose Estimation24 Oct 2024
- 2024Markerless Multi-view 3D Human Pose Estimation: a survey4 Jul 2024
- 2024UPose3D: Uncertainty-Aware 3D Human Pose Estimation with Cross-View and Temporal Cues23 Apr 2024
- 2023Multiple View Geometry Transformers for 3D Human Pose Estimation18 Nov 2023
- 2023Ego3DPose: Capturing 3D Cues from Binocular Egocentric Views21 Sep 2023
- 2023Probabilistic Triangulation for Uncalibrated Multi-View 3D Human Pose Estimation9 Sep 2023
- 2023Novel-view Synthesis and Pose Estimation for Hand-Object Interaction from Sparse Views22 Aug 2023
- 2023AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimation24 Apr 2023
- 2023HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learning2 Feb 2023
- 2022Multi-person 3D pose estimation from unlabelled data16 Dec 2022
- 2022Progressive Multi-view Human Mesh Recovery with Self-Supervision10 Dec 2022
- 2022Efficient Annotation and Learning for 3D Hand Pose Estimation: A Survey5 Jun 2022
- 2023AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimationcited by 64
- 2023Ego3DPose: Capturing 3D Cues from Binocular Egocentric Viewscited by 22
- 2023Multiple View Geometry Transformers for 3D Human Pose Estimationcited by 19
- 2022Efficient Annotation and Learning for 3D Hand Pose Estimation: A Surveycited by 17
- 2023Novel-view Synthesis and Pose Estimation for Hand-Object Interaction from Sparse Viewscited by 16
- 2022Progressive Multi-view Human Mesh Recovery with Self-Supervisioncited by 9
- 2024Markerless Multi-view 3D Human Pose Estimation: a surveycited by 9
- 2025MV-SSM: Multi-View State Space Modeling for 3D Human Pose Estimationcited by 9
- 2023HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learningcited by 7
- 2023Probabilistic Triangulation for Uncalibrated Multi-View 3D Human Pose Estimationcited by 7
- 2024UPose3D: Uncertainty-Aware 3D Human Pose Estimation with Cross-View and Temporal Cuescited by 6
- 2024VoxelKeypointFusion: Generalizable Multi-View Multi-Person Pose Estimationcited by 3
12 most cited of 24 All 24 (JSON)
- 2026HandMvNet: Real-Time 3D Hand Pose Estimation Using Multi-View Cross-Attention Fusion20 Aug 2026
- 2026Mesh-Aware Epipolar Matching for Multi-View Multi-Person 3D Pose Estimation in Basketball28 May 2026
- 2026Unconstrained Multi-view Human Pose Estimation with Algebraic Priors27 Apr 2026
- 2026Human Pose Estimation in Trampoline Gymnastics: How to Improve Performance on Extreme Poses1 Apr 2026
- 2026COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimation14 Jan 2026
- 2025RUMPL: Ray-Based Transformers for Universal Multi-View 2D to 3D Human Pose Lifting17 Dec 2025
- 2025SkelSplat: Robust Multi-view 3D Human Pose Estimation with Differentiable Gaussian Rendering11 Nov 2025
- 2025TrackStudio: An Integrated Toolkit for Markerless Tracking10 Nov 2025
- 2025MV-SSM: Multi-View State Space Modeling for 3D Human Pose Estimation31 Aug 2025
- 2025Pose Splatter: A 3D Gaussian Splatting Model for Quantifying Animal Pose and Appearance23 May 2025
- 2025DeProPose: Deficiency-Proof 3D Human Pose Estimation via Adaptive Multi-View Fusion23 Feb 2025
- 2024Marker-free Human Gait Analysis using a Smart Edge Sensor System14 Nov 2024
12 newest of 24 All 24 (JSON)