Learnable Triangulation of Human Pose
Not on the map. Why?
Abstract (arXiv)
We present two novel solutions for multi-view 3D human pose estimation based on new learnable triangulation methods that combine 3D information from multiple 2D views. The first (baseline) solution is a basic differentiable algebraic triangulation with an addition of confidence weights estimated from the input images. The second solution is based on a novel method of volumetric aggregation from intermediate 2D backbone feature maps. The aggregated volume is then refined via 3D convolutions that produce final 3D joint heatmaps and allow modelling a human pose prior. Crucially, both approaches are end-to-end differentiable, which allows us to directly optimize the target metric. We demonstrate transferability of the solutions across datasets and considerably improve the multi-view state of the art on the Human3.6M dataset. Video demonstration, annotations and additional materials will be posted on our project page (https://saic-violet.github.io/learnable-triangulation).
Key facts. Cited by 160 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 28; 2023: 41; 2024: 28; 2025: 21; 2026: 14.
160 papers.
Sort:
By area:
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
- 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2023Human Motion Generation: A Surveycited by 95
- 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 90
- 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypointscited by 77
- 2021Direct Multi-view Multi-person 3D Pose Estimationcited by 64
- 2023AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimationcited by 64
- 2023MotionAGFormer: Enhancing 3D Human Pose Estimation with a Transformer-GCNFormer Networkcited by 62
- 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
38 more
- 2021Conditional Directed Graph Convolution for 3D Human Pose Estimationcited by 52
- 2021Watch It Move: Unsupervised Discovery of 3D Joints for Re-Posing of Articulated Objectscited by 50
- 2022UmeTrack: Unified multi-view end-to-end hand tracking for VRcited by 48
- 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Videocited by 46
- 20233D Human Mesh Estimation from Virtual Markerscited by 44
- 2021VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wildcited by 39
- 2022Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projectioncited by 39
- 2021Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereocited by 38
- 2021Context Modeling in 3D Human Pose Estimation: A Unified Perspectivecited by 37
- 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
- 2021TransFusion: Cross-view Fusion with Transformer for 3D Human Pose Estimationcited by 32
- 2024Harmony4D: A Video Dataset for In-The-Wild Close Human Interactionscited by 31
- 2022The One Where They Reconstructed 3D Humans and Environments in TV Showscited by 30
- 2022Scene-aware Egocentric 3D Human Pose Estimationcited by 30
- 2021HUMAN4D: A Human-Centric Multimodal Dataset for Motions and Immersive Mediacited by 29
- 2022Cross-View Cross-Scene Multi-View Crowd Countingcited by 28
- 2022Interaction Replica: Tracking Human-Object Interaction and Scene Changes From Human Motioncited by 27
- 2022PPT: token-Pruned Pose Transformer for monocular and multi-view human pose estimationcited by 27
- 2022Efficient Human Pose Estimation via 3D Event Point Cloudcited by 25
- 2021Generalizable Human Pose Triangulationcited by 24
- 2021Shape-aware Multi-Person Pose Estimation from Multi-View Imagescited by 24
- 2023Back to Optimization: Diffusion-based Zero-Shot 3D Human Pose Estimationcited by 24
- 2023HDFormer: High-order Directed Transformer for 3D Human Pose Estimationcited by 23
- 2024Look Ma, no markers: holistic performance capture without the hasslecited by 23
- 2023TEMPO: Efficient Multi-View Pose Estimation, Tracking, and Forecastingcited by 22
- 2023Ego3DPose: Capturing 3D Cues from Binocular Egocentric Viewscited by 22
- 2024SelfPose3d: Self-Supervised Multi-Person Multi-View 3d Pose Estimationcited by 21
- 2023Vision-Based Human Pose Estimation via Deep Learning: A Surveycited by 20
- 2024A Comprehensive Survey of Action Quality Assessment: Method and Benchmarkcited by 20
- 2021Adaptive Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimationcited by 19
- 2023Multiple View Geometry Transformers for 3D Human Pose Estimationcited by 19
- 2022Efficient Annotation and Learning for 3D Hand Pose Estimation: A Surveycited by 17
- 2023Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capturecited by 17
- 2024ExpertAF: Expert Actionable Feedback from Videocited by 17
- 2022Learnable human mesh triangulation for 3D human pose and shape estimationcited by 16
- 2023Novel-view Synthesis and Pose Estimation for Hand-Object Interaction from Sparse Viewscited by 16
- 2024AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movementscited by 15
- 2021TrajeVAE: Controllable Human Motion Generation from Trajectoriescited by 14
50 most cited of 160 All 160 (JSON)
- 2026ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild28 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026MEOM: Multi-View Expected-OKS Maximization for Human Pose Triangulation31 Aug 2026
- 2026HandMvNet: Real-Time 3D Hand Pose Estimation Using Multi-View Cross-Attention Fusion20 Aug 2026
- 2026SkillSpotter: Pose-Aware Multi-View Skilled Action Detection and Grading in Ego-Exo Videos30 Jun 2026
- 2026DisPOSE: Projected Polystochastic Diffusion for Self-Supervised Multi-View 3D Human Pose Estimation5 Jun 2026
- 2026UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimation18 May 2026
- 2026EgoEV-HandPose: Egocentric 3D Hand Pose Estimation and Gesture Recognition with Stereo Event Cameras12 May 2026
- 2026Unconstrained Multi-view Human Pose Estimation with Algebraic Priors27 Apr 2026
- 2026Dual-stream Spatio-Temporal GCN-Transformer Network for 3D Human Pose Estimation20 Apr 2026
- 2026SynMVCrowd: A Large Synthetic Benchmark for Multi-view Crowd Counting and Localization25 Mar 2026
- 2026Monocular Models are Strong Learners for Multi-View Human Mesh Recovery20 Mar 2026
38 more
- 2026COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimation14 Jan 2026
- 2026RePose: A Real-Time 3D Human Pose Estimation and Biomechanical Analysis Framework for Rehabilitation2 Jan 2026
- 2025RUMPL: Ray-Based Transformers for Universal Multi-View 2D to 3D Human Pose Lifting17 Dec 2025
- 2025Enhancing Multi-Camera Gymnast Tracking Through Domain Knowledge Integration20 Nov 2025
- 2025SkelSplat: Robust Multi-view 3D Human Pose Estimation with Differentiable Gaussian Rendering11 Nov 2025
- 2025TrackStudio: An Integrated Toolkit for Markerless Tracking10 Nov 2025
- 2025Kineo: Calibration-Free Metric Motion Capture From Sparse RGB Cameras28 Oct 2025
- 2025AssemblyHands-X: Modeling 3D Hand-Body Coordination for Understanding Bimanual Human Activities28 Sep 2025
- 2025MV-SSM: Multi-View State Space Modeling for 3D Human Pose Estimation31 Aug 2025
- 2025DiffCap: Diffusion-based Real-time Human Motion Capture using Sparse IMUs and a Monocular Camera8 Aug 2025
- 2025Multi-view Gaze Target Estimation7 Aug 2025
- 2025Unsupervised Monocular 3D Keypoint Discovery from Multi-View Diffusion Priors16 Jul 2025
- 2025MAMMA: Markerless & Automatic Multi-Person Motion Action Capture16 Jun 2025
- 2025Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forward31 May 2025
- 2025Pose Splatter: A 3D Gaussian Splatting Model for Quantifying Animal Pose and Appearance23 May 2025
- 2025Towards Application-Specific Evaluation of Vision Models: Case Studies in Ecology and Biology5 May 2025
- 2025P2P-Insole: Human Pose Estimation Using Foot Pressure Distribution and Motion Sensors1 May 2025
- 2025RapidPoseTriangulation: Multi-view Multi-person Whole-body Human Pose Triangulation in a Millisecond27 Mar 2025
- 2025Physically Plausible Human-Object Rendering from Sparse Views via 3D Gaussian Splatting12 Mar 2025
- 2025AthletePose3D: A Benchmark Dataset for 3D Human Pose Estimation and Kinematic Validation in Athletic Movements10 Mar 2025
- 2025DeProPose: Deficiency-Proof 3D Human Pose Estimation via Adaptive Multi-View Fusion23 Feb 2025
- 2025Measuring Physical Plausibility of 3D Human Poses Using Physics Simulation6 Feb 2025
- 2025SimpleDepthPose: Fast and Reliable Human Pose Estimation with RGBD-Images30 Jan 2025
- 2024Pre-training a Density-Aware Pose Transformer for Robust LiDAR-based 3D Human Pose Estimation18 Dec 2024
- 2024CondiMen: Conditional Multi-Person Mesh Recovery17 Dec 2024
- 2024A Comprehensive Survey of Action Quality Assessment: Method and Benchmark15 Dec 2024
- 2024HeatFormer: A Neural Optimizer for Multiview Human Mesh Recovery5 Dec 2024
- 2024Harmony4D: A Video Dataset for In-The-Wild Close Human Interactions27 Oct 2024
- 2024VoxelKeypointFusion: Generalizable Multi-View Multi-Person Pose Estimation24 Oct 2024
- 2024Look Ma, no markers: holistic performance capture without the hassle15 Oct 2024
- 2024V-Hands: Touchscreen-based Hand Tracking for Remote Whiteboard Interaction20 Sep 2024
- 2024Multi-view Pose Fusion for Occlusion-Aware 3D Human Pose Estimation28 Aug 2024
- 2024Comparison of Kinematics and Kinetics Between OpenCap and a Marker-Based Motion Capture System in Cycling20 Aug 2024
- 2024Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Network6 Aug 2024
- 2024ExpertAF: Expert Actionable Feedback from Video1 Aug 2024
- 2024Multi-View People Detection in Large Scenes via Supervised View-Wise Contribution Weighting30 May 2024
- 2024AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movements20 May 2024
- 2024FPDIoU Loss: A Loss Function for Efficient Bounding Box Regression of Rotated Object Detection16 May 2024
50 newest of 160 All 160 (JSON)
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
- 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2023Human Motion Generation: A Surveycited by 95
- 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 90
- 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypointscited by 77
- 2021Direct Multi-view Multi-person 3D Pose Estimationcited by 64
- 2023AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimationcited by 64
- 2023MotionAGFormer: Enhancing 3D Human Pose Estimation with a Transformer-GCNFormer Networkcited by 62
- 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
12 most cited of 158 All 158 (JSON)
- 2026ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild28 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026MEOM: Multi-View Expected-OKS Maximization for Human Pose Triangulation31 Aug 2026
- 2026HandMvNet: Real-Time 3D Hand Pose Estimation Using Multi-View Cross-Attention Fusion20 Aug 2026
- 2026SkillSpotter: Pose-Aware Multi-View Skilled Action Detection and Grading in Ego-Exo Videos30 Jun 2026
- 2026DisPOSE: Projected Polystochastic Diffusion for Self-Supervised Multi-View 3D Human Pose Estimation5 Jun 2026
- 2026UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimation18 May 2026
- 2026EgoEV-HandPose: Egocentric 3D Hand Pose Estimation and Gesture Recognition with Stereo Event Cameras12 May 2026
- 2026Unconstrained Multi-view Human Pose Estimation with Algebraic Priors27 Apr 2026
- 2026Dual-stream Spatio-Temporal GCN-Transformer Network for 3D Human Pose Estimation20 Apr 2026
- 2026SynMVCrowd: A Large Synthetic Benchmark for Multi-view Crowd Counting and Localization25 Mar 2026
- 2026Monocular Models are Strong Learners for Multi-View Human Mesh Recovery20 Mar 2026
12 newest of 158 All 158 (JSON)