3D Human Pose Estimation in RGBD Images for Robotic Task Learning
Not on the map. Why?
Abstract (arXiv)
We propose an approach to estimate 3D human pose in real world units from a single RGBD image and show that it exceeds performance of monocular 3D pose estimation approaches from color as well as pose estimation exclusively from depth. Our approach builds on robust human keypoint detectors for color images and incorporates depth for lifting into 3D. We combine the system with our learning from demonstration framework to instruct a service robot without the need of markers. Experiments in real world settings demonstrate that our approach enables a PR2 robot to imitate manipulation actions observed from a human teacher.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 7; 2022: 5; 2023: 4; 2024: 4; 2025: 11; 2026: 1.
33 papers.
Sort:
By area:
- 2023IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbudscited by 52
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 39
- 2022DiffuPose: Monocular 3D Human Pose Estimation via Denoising Diffusion Probabilistic Modelcited by 29
- 2024DITTO: Demonstration Imitation by Trajectory Transformationcited by 28
- 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDARcited by 23
- 2022HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Drivingcited by 22
- 2023Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimationcited by 15
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimationcited by 11
- 2023LPFormer: LiDAR Pose Estimation Transformer with Multi-Task Networkcited by 9
- 20213D Human Pose Regression using Graph Convolutional Networkcited by 8
- 2023Neuromorphic High-Frequency 3D Dancing Pose Estimation in Dynamic Environmentcited by 8
- 2021Cross-Modal Analysis of Human Detection for Robotics: An Industrial Case Studycited by 5
21 more
- 2022Towards a Comprehensive Solution for a Vision-based Digitized Neurological Examinationcited by 5
- 2024HANDI: Hand-Centric Text-and-Image Conditioned Video Generationcited by 5
- 2025mmDEAR: mmWave Point Cloud Density Enhancement for Accurate Human Body Reconstructioncited by 5
- 2025H2OT: Hierarchical Hourglass Tokenizer for Efficient Video Pose Transformerscited by 5
- 2024Human Modelling and Pose Estimation Overviewcited by 4
- 2019Combined Task and Action Learning from Human Demonstrations for Mobile Manipulation Applicationscited by 3
- 2021Heuristic Weakly Supervised 3D Human Pose Estimationcited by 3
- 2025GA3CE: Unconstrained 3D Gaze Estimation with Gaze-Aware 3D Context Encodingcited by 3
- 2022Human keypoint detection for close proximity human-robot interactioncited by 2
- 2024Depth-based Privileged Information for Boosting 3D Human Pose Estimation on RGBcited by 1
- 2025Unsupervised Cross-Domain 3D Human Pose Estimation via Pseudo-Label-Guided Global Transformscited by 1
- 2025Real-Time Human-Robot Interaction Intent Detection Using RGB-based Pose and Emotion Cues with Cross-Camera Model Generalizationcited by 1
- 2021Efficient Realistic Data Generation Framework leveraging Deep Learning-based Human Digitizationcited by 0
- 2021A3GC-IP: Attention-Oriented Adjacency Adaptive Recurrent Graph Convolutions for Human Pose Estimation from Sparse Inertial Measurementscited by 0
- 2021DeepMoCap: Deep Optical Motion Capture Using Multiple Depth Sensors and Retro-Reflectorscited by 0
- 2025From Neck to Head: Bio-Impedance Sensing for Head Pose Estimationcited by 0
- 2025Efficient Diffusion-Based 3D Human Pose Estimation with Hierarchical Temporal Pruningcited by 0
- 2025A3RNN: Bi-directional Fusion of Bottom-up and Top-down Process for Developmental Visual Attention in Robotscited by 0
- 2025A Novel Grouping-Based Hybrid Color Correction Algorithm for Color Point Cloudscited by 0
- 2025SkelSplat: Robust Multi-view 3D Human Pose Estimation with Differentiable Gaussian Renderingcited by 0
- 2026Sparkle: A Robust and Versatile Representation for Point Cloud based Human Motion Capturecited by 0
- 2026Sparkle: A Robust and Versatile Representation for Point Cloud based Human Motion Capture1 Apr 2026
- 2025Real-Time Human-Robot Interaction Intent Detection Using RGB-based Pose and Emotion Cues with Cross-Camera Model Generalization18 Dec 2025
- 2025SkelSplat: Robust Multi-view 3D Human Pose Estimation with Differentiable Gaussian Rendering11 Nov 2025
- 2025A Novel Grouping-Based Hybrid Color Correction Algorithm for Color Point Clouds4 Nov 2025
- 2025A3RNN: Bi-directional Fusion of Bottom-up and Top-down Process for Developmental Visual Attention in Robots11 Oct 2025
- 2025H2OT: Hierarchical Hourglass Tokenizer for Efficient Video Pose Transformers8 Sep 2025
- 2025Efficient Diffusion-Based 3D Human Pose Estimation with Hierarchical Temporal Pruning29 Aug 2025
- 2025From Neck to Head: Bio-Impedance Sensing for Head Pose Estimation17 Jul 2025
- 2025GA3CE: Unconstrained 3D Gaze Estimation with Gaze-Aware 3D Context Encoding15 May 2025
- 2025Unsupervised Cross-Domain 3D Human Pose Estimation via Pseudo-Label-Guided Global Transforms17 Apr 2025
- 2025mmDEAR: mmWave Point Cloud Density Enhancement for Accurate Human Body Reconstruction4 Mar 2025
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimation9 Jan 2025
21 more
- 2024HANDI: Hand-Centric Text-and-Image Conditioned Video Generation5 Dec 2024
- 2024Depth-based Privileged Information for Boosting 3D Human Pose Estimation on RGB17 Sep 2024
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
- 2024DITTO: Demonstration Imitation by Trajectory Transformation22 Mar 2024
- 2023Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimation20 Nov 2023
- 2023LPFormer: LiDAR Pose Estimation Transformer with Multi-Task Network21 Jun 2023
- 2023IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbuds25 Apr 2023
- 2023Neuromorphic High-Frequency 3D Dancing Pose Estimation in Dynamic Environment17 Jan 2023
- 2022HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Driving15 Dec 2022
- 2022DiffuPose: Monocular 3D Human Pose Estimation via Denoising Diffusion Probabilistic Model6 Dec 2022
- 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDAR30 Nov 2022
- 2022Human keypoint detection for close proximity human-robot interaction15 Jul 2022
- 2022Towards a Comprehensive Solution for a Vision-based Digitized Neurological Examination15 May 2022
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Driving22 Dec 2021
- 2021DeepMoCap: Deep Optical Motion Capture Using Multiple Depth Sensors and Retro-Reflectors14 Oct 2021
- 2021Cross-Modal Analysis of Human Detection for Robotics: An Industrial Case Study3 Aug 2021
- 2021A3GC-IP: Attention-Oriented Adjacency Adaptive Recurrent Graph Convolutions for Human Pose Estimation from Sparse Inertial Measurements23 Jul 2021
- 2021Efficient Realistic Data Generation Framework leveraging Deep Learning-based Human Digitization28 Jun 2021
- 2021Heuristic Weakly Supervised 3D Human Pose Estimation23 May 2021
- 20213D Human Pose Regression using Graph Convolutional Network21 May 2021
- 2019Combined Task and Action Learning from Human Demonstrations for Mobile Manipulation Applications25 Aug 2019
- 2023IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbudscited by 52
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 39
- 2024DITTO: Demonstration Imitation by Trajectory Transformationcited by 28
- 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDARcited by 23
- 2022HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Drivingcited by 22
- 2023Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimationcited by 15
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimationcited by 11
- 2023LPFormer: LiDAR Pose Estimation Transformer with Multi-Task Networkcited by 9
- 20213D Human Pose Regression using Graph Convolutional Networkcited by 8
- 2023Neuromorphic High-Frequency 3D Dancing Pose Estimation in Dynamic Environmentcited by 8
- 2021Cross-Modal Analysis of Human Detection for Robotics: An Industrial Case Studycited by 5
- 2022Towards a Comprehensive Solution for a Vision-based Digitized Neurological Examinationcited by 5
12 most cited of 30 All 30 (JSON)
- 2026Sparkle: A Robust and Versatile Representation for Point Cloud based Human Motion Capture1 Apr 2026
- 2025Real-Time Human-Robot Interaction Intent Detection Using RGB-based Pose and Emotion Cues with Cross-Camera Model Generalization18 Dec 2025
- 2025SkelSplat: Robust Multi-view 3D Human Pose Estimation with Differentiable Gaussian Rendering11 Nov 2025
- 2025A Novel Grouping-Based Hybrid Color Correction Algorithm for Color Point Clouds4 Nov 2025
- 2025A3RNN: Bi-directional Fusion of Bottom-up and Top-down Process for Developmental Visual Attention in Robots11 Oct 2025
- 2025H2OT: Hierarchical Hourglass Tokenizer for Efficient Video Pose Transformers8 Sep 2025
- 2025From Neck to Head: Bio-Impedance Sensing for Head Pose Estimation17 Jul 2025
- 2025GA3CE: Unconstrained 3D Gaze Estimation with Gaze-Aware 3D Context Encoding15 May 2025
- 2025Unsupervised Cross-Domain 3D Human Pose Estimation via Pseudo-Label-Guided Global Transforms17 Apr 2025
- 2025mmDEAR: mmWave Point Cloud Density Enhancement for Accurate Human Body Reconstruction4 Mar 2025
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimation9 Jan 2025
- 2024HANDI: Hand-Centric Text-and-Image Conditioned Video Generation5 Dec 2024
12 newest of 30 All 30 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024RoboKeyGen: Robot Pose and Joint Angles Estimation via Diffusion-based 3D Keypoint Generation
- 2026Dexterity-BEV: Aligning 3D World and Actions for Generalizable Robot Policies Learning
- 2026Pointing-Based Object Recognition
- 2026Flow Matching for Probabilistic Monocular 3D Human Pose Estimation
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models
- 2025Learning Category-level Last-meter Navigation from RGB Demonstrations of a Single-instance ↗
- 2026Monocular 3D Object Position Estimation with VLMs for Human-Robot Interaction
- 2026On the Generalization Capabilities, Design Choices and Limitations of Keypoint Imitation Learning