Cross View Fusion for 3D Human Pose Estimation
Not on the map. Why?
Abstract (arXiv)
We present an approach to recover absolute 3D human poses from multi-view images by incorporating multi-view geometric priors in our model. It consists of two separate steps: (1) estimating the 2D poses in multi-view images and (2) recovering the 3D poses from the multi-view 2D poses. First, we introduce a cross-view fusion scheme into CNN to jointly estimate 2D poses for multiple views. Consequently, the 2D pose estimation for each view already benefits from other views. Second, we present a recursive Pictorial Structure Model to recover the 3D pose from the multi-view 2D poses. It gradually improves the accuracy of 3D pose with affordable computational cost. We test our method on two public datasets H36M and Total Capture. The Mean Per Joint Position Errors on the two datasets are 26mm and 29mm, which outperforms the state-of-the-arts remarkably (26mm vs 52mm, 29mm vs 35mm). Our code is released at urlhttps://github.com/microsoft/multiview-human-pose-estimation-pytorch.
Key facts. Cited by 90 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 16; 2023: 21; 2024: 9; 2025: 13; 2026: 5.
90 papers.
Sort:
By area:
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
- 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 90
- 2021Direct Multi-view Multi-person 3D Pose Estimationcited by 64
- 2021Conditional Directed Graph Convolution for 3D Human Pose Estimationcited by 52
- 20233D Human Mesh Estimation from Virtual Markerscited by 44
- 2021VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wildcited by 39
- 2022Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projectioncited by 39
38 more
- 2021Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereocited by 38
- 2021Context Modeling in 3D Human Pose Estimation: A Unified Perspectivecited by 37
- 2023PACE: Human and Camera Motion Estimation from in-the-wild Videoscited by 33
- 2021TransFusion: Cross-view Fusion with Transformer for 3D Human Pose Estimationcited by 32
- 2021AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wildcited by 29
- 2021HUMAN4D: A Human-Centric Multimodal Dataset for Motions and Immersive Mediacited by 29
- 2022PPT: token-Pruned Pose Transformer for monocular and multi-view human pose estimationcited by 27
- 2021Generalizable Human Pose Triangulationcited by 24
- 2021Shape-aware Multi-Person Pose Estimation from Multi-View Imagescited by 24
- 2023HDFormer: High-order Directed Transformer for 3D Human Pose Estimationcited by 23
- 2023TEMPO: Efficient Multi-View Pose Estimation, Tracking, and Forecastingcited by 22
- 2023Ego3DPose: Capturing 3D Cues from Binocular Egocentric Viewscited by 22
- 2024SelfPose3d: Self-Supervised Multi-Person Multi-View 3d Pose Estimationcited by 21
- 2023Vision-Based Human Pose Estimation via Deep Learning: A Surveycited by 20
- 2021Adaptive Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimationcited by 19
- 2023Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capturecited by 17
- 2021Real-Time Multi-View 3D Human Pose Estimation using Semantic Feedback to Smart Edge Sensorscited by 16
- 2022Learnable human mesh triangulation for 3D human pose and shape estimationcited by 16
- 2021Weakly-supervised 3D Human Pose Estimation with Cross-view U-shaped Graph Convolutional Networkcited by 13
- 2023Proactive Multi-Camera Collaboration For 3D Human Pose Estimationcited by 13
- 2021Part-Aware Measurement for Robust Multi-View Multi-Human 3D Pose Estimation and Trackingcited by 12
- 2024CountFormer: Multi-View Crowd Counting Transformercited by 12
- 2024Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Networkcited by 12
- 2021FLEX: Extrinsic Parameters-free Multi-view 3D Human Motion Reconstructioncited by 11
- 2022AirPose: Multi-View Fusion Network for Aerial 3D Human Pose and Shape Estimationcited by 11
- 2021Self-Supervised 3D Human Pose Estimation with Multiple-View Geometrycited by 10
- 2022Progressive Multi-view Human Mesh Recovery with Self-Supervisioncited by 9
- 2023POEM: Reconstructing Hand in a Point Embedded Multi-view Stereocited by 9
- 2023Spectral Graphormer: Spectral Graph-based Transformer for Egocentric Two-Hand Reconstruction using Multi-View Color Imagescited by 9
- 2023HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learningcited by 7
- 2023Probabilistic Triangulation for Uncalibrated Multi-View 3D Human Pose Estimationcited by 7
- 2023FreeMan: Towards Benchmarking 3D Human Pose Estimation under Real-World Conditionscited by 7
- 2022FusePose: IMU-Vision Sensor Fusion in Kinematic Space for Parametric Human Pose Estimationcited by 6
- 2022Weakly-supervised Pre-training for 3D Human Pose Estimation via Perspective Knowledgecited by 6
- 2023View Consistency Aware Holistic Triangulation for 3D Human Pose Estimationcited by 6
- 2024UPose3D: Uncertainty-Aware 3D Human Pose Estimation with Cross-View and Temporal Cuescited by 6
- 20223D Semantic Scene Perception using Distributed Smart Edge Sensorscited by 5
- 2024MUC: Mixture of Uncalibrated Cameras for Robust 3D Human Body Reconstructioncited by 5
50 most cited of 90 All 90 (JSON)
- 2026MEOM: Multi-View Expected-OKS Maximization for Human Pose Triangulation31 Aug 2026
- 2026Sen-Cap: Sensor-Flexible and Noise-Resilient Human Motion Capture via LiDAR-Camera Integration3 Aug 2026
- 2026Unconstrained Multi-view Human Pose Estimation with Algebraic Priors27 Apr 2026
- 2026BarbieGait: An Identity-Consistent Synthetic Human Dataset with Versatile Cloth-Changing for Gait Recognition14 Apr 2026
- 2026Vision-Language Models for Ergonomic Assessment of Manual Lifting Tasks: Estimating Horizontal and Vertical Hand Distances from RGB Video24 Feb 2026
- 2025RUMPL: Ray-Based Transformers for Universal Multi-View 2D to 3D Human Pose Lifting17 Dec 2025
- 2025SkelSplat: Robust Multi-view 3D Human Pose Estimation with Differentiable Gaussian Rendering11 Nov 2025
- 2025Kineo: Calibration-Free Metric Motion Capture From Sparse RGB Cameras28 Oct 2025
- 2025An uncertainty-aware framework for data-efficient multi-view animal pose estimation10 Oct 2025
- 2025Multi-View Crowd Counting With Self-Supervised Learning26 Sep 2025
- 2025DiffCap: Diffusion-based Real-time Human Motion Capture using Sparse IMUs and a Monocular Camera8 Aug 2025
- 2025Multi-view Gaze Target Estimation7 Aug 2025
38 more
- 2025Pose Splatter: A 3D Gaussian Splatting Model for Quantifying Animal Pose and Appearance23 May 2025
- 2025Cooperative Inference for Real-Time 3D Human Pose Estimation in Multi-Device Edge Networks3 Apr 2025
- 2025Multi-View Industrial Anomaly Detection with Epipolar Constrained Cross-View Fusion14 Mar 2025
- 2025Physically Plausible Human-Object Rendering from Sparse Views via 3D Gaussian Splatting12 Mar 2025
- 2025DeProPose: Deficiency-Proof 3D Human Pose Estimation via Adaptive Multi-View Fusion23 Feb 2025
- 2025Measuring Physical Plausibility of 3D Human Poses Using Physics Simulation6 Feb 2025
- 2024CondiMen: Conditional Multi-Person Mesh Recovery17 Dec 2024
- 2024Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Network6 Aug 2024
- 2024CountFormer: Multi-View Crowd Counting Transformer2 Jul 2024
- 2024UPose3D: Uncertainty-Aware 3D Human Pose Estimation with Cross-View and Temporal Cues23 Apr 2024
- 2024SelfPose3d: Self-Supervised Multi-Person Multi-View 3d Pose Estimation2 Apr 2024
- 2024Self-learning Canonical Space for Multi-view 3D Human Pose Estimation19 Mar 2024
- 2024QEAN: Quaternion-Enhanced Attention Network for Visual Dance Generation18 Mar 2024
- 2024MUC: Mixture of Uncalibrated Cameras for Robust 3D Human Body Reconstruction8 Mar 2024
- 2024Towards Precise 3D Human Pose Estimation with Multi-Perspective Spatial-Temporal Relational Transformers30 Jan 2024
- 2023Geometry-Biased Transformer for Robust Multi-View 3D Human Pose Reconstruction28 Dec 2023
- 2023RSB-Pose: Robust Short-Baseline Binocular 3D Human Pose Estimation with Occlusion Handling24 Nov 2023
- 2023PACE: Human and Camera Motion Estimation from in-the-wild Videos20 Oct 2023
- 2023Ego3DPose: Capturing 3D Cues from Binocular Egocentric Views21 Sep 2023
- 2023TEMPO: Efficient Multi-View Pose Estimation, Tracking, and Forecasting14 Sep 2023
- 2023FreeMan: Towards Benchmarking 3D Human Pose Estimation under Real-World Conditions10 Sep 2023
- 2023Probabilistic Triangulation for Uncalibrated Multi-View 3D Human Pose Estimation9 Sep 2023
- 2023Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capture1 Sep 2023
- 2023Vision-Based Human Pose Estimation via Deep Learning: A Survey26 Aug 2023
- 2023Spectral Graphormer: Spectral Graph-based Transformer for Egocentric Two-Hand Reconstruction using Multi-View Color Images21 Aug 2023
- 2023Iterative Graph Filtering Network for 3D Human Pose Estimation29 Jul 2023
- 2023Selecting the motion ground truth for loose-fitting wearables: benchmarking optical MoCap methods21 Jul 2023
- 2023A marker-less human motion analysis system for motion-based biomarker discovery in knee disorders26 Apr 2023
- 2023POEM: Reconstructing Hand in a Point Embedded Multi-view Stereo8 Apr 2023
- 2023ConvFormer: Parameter Reduction in Transformer Models for 3D Human Pose Estimation by Leveraging Dynamic Multi-Headed Convolutional Attention4 Apr 2023
- 20233D Human Mesh Estimation from Virtual Markers21 Mar 2023
- 2023Proactive Multi-Camera Collaboration For 3D Human Pose Estimation7 Mar 2023
- 2023View Consistency Aware Holistic Triangulation for 3D Human Pose Estimation22 Feb 2023
- 2023HDFormer: High-order Directed Transformer for 3D Human Pose Estimation3 Feb 2023
- 2023HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learning2 Feb 2023
- 2023E3Pose: Energy-Efficient Edge-assisted Multi-camera System for Multi-human 3D Pose Estimation21 Jan 2023
- 2022Progressive Multi-view Human Mesh Recovery with Self-Supervision10 Dec 2022
- 2022Weakly-supervised Pre-training for 3D Human Pose Estimation via Perspective Knowledge22 Nov 2022
50 newest of 90 All 90 (JSON)
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
- 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 203
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 90
- 2021Direct Multi-view Multi-person 3D Pose Estimationcited by 64
- 2021Conditional Directed Graph Convolution for 3D Human Pose Estimationcited by 52
- 20233D Human Mesh Estimation from Virtual Markerscited by 44
- 2021VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wildcited by 39
- 2022Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projectioncited by 39
12 most cited of 88 All 88 (JSON)
- 2026MEOM: Multi-View Expected-OKS Maximization for Human Pose Triangulation31 Aug 2026
- 2026Sen-Cap: Sensor-Flexible and Noise-Resilient Human Motion Capture via LiDAR-Camera Integration3 Aug 2026
- 2026Unconstrained Multi-view Human Pose Estimation with Algebraic Priors27 Apr 2026
- 2026BarbieGait: An Identity-Consistent Synthetic Human Dataset with Versatile Cloth-Changing for Gait Recognition14 Apr 2026
- 2025RUMPL: Ray-Based Transformers for Universal Multi-View 2D to 3D Human Pose Lifting17 Dec 2025
- 2025SkelSplat: Robust Multi-view 3D Human Pose Estimation with Differentiable Gaussian Rendering11 Nov 2025
- 2025Kineo: Calibration-Free Metric Motion Capture From Sparse RGB Cameras28 Oct 2025
- 2025An uncertainty-aware framework for data-efficient multi-view animal pose estimation10 Oct 2025
- 2025Multi-View Crowd Counting With Self-Supervised Learning26 Sep 2025
- 2025DiffCap: Diffusion-based Real-time Human Motion Capture using Sparse IMUs and a Monocular Camera8 Aug 2025
- 2025Multi-view Gaze Target Estimation7 Aug 2025
- 2025Pose Splatter: A 3D Gaussian Splatting Model for Quantifying Animal Pose and Appearance23 May 2025
12 newest of 88 All 88 (JSON)