HPERL: 3D Human Pose Estimation from RGB and LiDAR
Not on the map. Why?
Abstract (arXiv)
In-the-wild human pose estimation has a huge potential for various fields, ranging from animation and action recognition to intention recognition and prediction for autonomous driving. The current state-of-the-art is focused only on RGB and RGB-D approaches for predicting the 3D human pose. However, not using precise LiDAR depth information limits the performance and leads to very inaccurate absolute pose estimation. With LiDAR sensors becoming more affordable and common on robots and autonomous vehicle setups, we propose an end-to-end architecture using RGB and LiDAR to predict the absolute 3D human pose with unprecedented precision. Additionally, we introduce a weakly-supervised approach to generate 3D predictions using 2D pose annotations from PedX [1]. This allows for many new opportunities in the field of 3D human pose estimation.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 2; 2024: 5; 2025: 4; 2026: 2.
18 papers.
Sort:
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 39
- 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDARcited by 23
- 2022HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Drivingcited by 22
- 2024RELI11D: A Comprehensive Multimodal Human Motion Dataset and Methodcited by 16
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimationcited by 11
- 20233D Human Keypoints Estimation From Point Clouds in the Wild Without Human Labelscited by 9
- 2024Human Modelling and Pose Estimation Overviewcited by 4
- 2024Pre-training a Density-Aware Pose Transformer for Robust LiDAR-based 3D Human Pose Estimationcited by 4
- 2024Improving Real-Time Omnidirectional 3D Multi-Person Human Pose Estimation with People Matching and Unsupervised 2D-3D Liftingcited by 2
- 2024Towards Multi-Modal Animal Pose Estimation: A Survey and In-Depth Analysiscited by 2
- 2025RISE: Single Static Radar-based Indoor Scene Understandingcited by 2
- 2023LiCamPose: Combining Multi-View LiDAR and RGB Cameras for Robust Single-timestamp 3D Human Pose Estimationcited by 1
6 more
- 2025P2P-Insole: Human Pose Estimation Using Foot Pressure Distribution and Motion Sensorscited by 1
- 2021Neural Network Based Lidar Gesture Recognition for Realtime Robot Teleoperationcited by 0
- 2022Object Permanence in Object Detection Leveraging Temporal Priors at Inference Timecited by 0
- 20253D Human Pose and Shape Estimation from LiDAR Point Clouds: A Reviewcited by 0
- 2026Learning Human-Object Interaction for 3D Human Pose Estimation from LiDAR Point Cloudscited by 0
- 2026Contactless 3D Human Body Measurement Using Depth Cameras for Smart Health Monitoringcited by 0
- 2026Contactless 3D Human Body Measurement Using Depth Cameras for Smart Health Monitoring10 Jun 2026
- 2026Learning Human-Object Interaction for 3D Human Pose Estimation from LiDAR Point Clouds17 Mar 2026
- 2025RISE: Single Static Radar-based Indoor Scene Understanding18 Nov 2025
- 20253D Human Pose and Shape Estimation from LiDAR Point Clouds: A Review15 Sep 2025
- 2025P2P-Insole: Human Pose Estimation Using Foot Pressure Distribution and Motion Sensors1 May 2025
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimation9 Jan 2025
- 2024Pre-training a Density-Aware Pose Transformer for Robust LiDAR-based 3D Human Pose Estimation18 Dec 2024
- 2024Towards Multi-Modal Animal Pose Estimation: A Survey and In-Depth Analysis12 Oct 2024
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
- 2024RELI11D: A Comprehensive Multimodal Human Motion Dataset and Method28 Mar 2024
- 2024Improving Real-Time Omnidirectional 3D Multi-Person Human Pose Estimation with People Matching and Unsupervised 2D-3D Lifting14 Mar 2024
- 2023LiCamPose: Combining Multi-View LiDAR and RGB Cameras for Robust Single-timestamp 3D Human Pose Estimation11 Dec 2023
6 more
- 20233D Human Keypoints Estimation From Point Clouds in the Wild Without Human Labels7 Jun 2023
- 2022HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Driving15 Dec 2022
- 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDAR30 Nov 2022
- 2022Object Permanence in Object Detection Leveraging Temporal Priors at Inference Time28 Nov 2022
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Driving22 Dec 2021
- 2021Neural Network Based Lidar Gesture Recognition for Realtime Robot Teleoperation17 Sep 2021
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 39
- 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDARcited by 23
- 2022HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Drivingcited by 22
- 2024RELI11D: A Comprehensive Multimodal Human Motion Dataset and Methodcited by 16
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimationcited by 11
- 20233D Human Keypoints Estimation From Point Clouds in the Wild Without Human Labelscited by 9
- 2024Human Modelling and Pose Estimation Overviewcited by 4
- 2024Pre-training a Density-Aware Pose Transformer for Robust LiDAR-based 3D Human Pose Estimationcited by 4
- 2024Improving Real-Time Omnidirectional 3D Multi-Person Human Pose Estimation with People Matching and Unsupervised 2D-3D Liftingcited by 2
- 2024Towards Multi-Modal Animal Pose Estimation: A Survey and In-Depth Analysiscited by 2
- 2025RISE: Single Static Radar-based Indoor Scene Understandingcited by 2
- 2023LiCamPose: Combining Multi-View LiDAR and RGB Cameras for Robust Single-timestamp 3D Human Pose Estimationcited by 1
12 most cited of 18 All 18 (JSON)
- 2026Contactless 3D Human Body Measurement Using Depth Cameras for Smart Health Monitoring10 Jun 2026
- 2026Learning Human-Object Interaction for 3D Human Pose Estimation from LiDAR Point Clouds17 Mar 2026
- 2025RISE: Single Static Radar-based Indoor Scene Understanding18 Nov 2025
- 20253D Human Pose and Shape Estimation from LiDAR Point Clouds: A Review15 Sep 2025
- 2025P2P-Insole: Human Pose Estimation Using Foot Pressure Distribution and Motion Sensors1 May 2025
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimation9 Jan 2025
- 2024Pre-training a Density-Aware Pose Transformer for Robust LiDAR-based 3D Human Pose Estimation18 Dec 2024
- 2024Towards Multi-Modal Animal Pose Estimation: A Survey and In-Depth Analysis12 Oct 2024
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
- 2024RELI11D: A Comprehensive Multimodal Human Motion Dataset and Method28 Mar 2024
- 2024Improving Real-Time Omnidirectional 3D Multi-Person Human Pose Estimation with People Matching and Unsupervised 2D-3D Lifting14 Mar 2024
- 2023LiCamPose: Combining Multi-View LiDAR and RGB Cameras for Robust Single-timestamp 3D Human Pose Estimation11 Dec 2023
12 newest of 18 All 18 (JSON)