# In-Bed Pose Estimation: Deep Learning with Shallow Dataset

arXiv: https://arxiv.org/abs/1711.01005 · HTML: https://mlsanity.com/paper/1711.01005/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Nov 2017.

## Built on by (most cited first, 11 of 11)

- [BodyPressure -- Inferring Body Pose and Contact Pressure from a Depth Image](https://mlsanity.com/paper/2105.09936/) (2021)
- [InfAnFace: Bridging the infant-adult domain gap in facial landmark estimation in the wild](https://mlsanity.com/paper/2110.08935/) (2021)
- [In-Bed Human Pose Estimation from Unseen and Privacy-Preserving Image Domains](https://mlsanity.com/paper/2111.15124/) (2021)
- [Privacy-Preserving In-Bed Pose Monitoring: A Fusion and Reconstruction Study](https://mlsanity.com/paper/2202.10704/) (2022)
- [Estimating Pose from Pressure Data for Smart Beds with Deep Image-based Pose Estimators](https://mlsanity.com/paper/2206.06518/) (2022)
- [Identity and Posture Recognition in Smart Beds with Deep Multitask Learning](https://mlsanity.com/paper/2104.02159/) (2021)
- [Pressure Eye: In-bed Contact Pressure Estimation via Contact-less Imaging](https://mlsanity.com/paper/2201.11828/) (2022)
- [PI-HMR: Towards Robust In-bed Temporal Human Shape Reconstruction with Contact Pressure Sensing](https://mlsanity.com/paper/2503.00068/) (2025)
- [Video-Based Inpatient Fall Risk Assessment: A Case Study](https://mlsanity.com/paper/2106.07565/) (2021)
- [SwinFuSR: an image fusion-inspired model for RGB-guided thermal image super-resolution](https://mlsanity.com/paper/2404.14533/) (2024)
- [In-Bed Pose Estimation: A Review](https://mlsanity.com/paper/2402.00700/) (2024)

## Abstract (arXiv)

Although human pose estimation for various computer vision (CV) applications has been studied extensively in the last few decades, yet in-bed pose estimation using camera-based vision methods has been ignored by the CV community because it is assumed to be identical to the general purpose pose estimation methods. However, in-bed pose estimation has its own specialized aspects and comes with specific challenges including the notable differences in lighting conditions throughout a day and also having different pose distribution from the common human surveillance viewpoint. In this paper, we demonstrate that these challenges significantly lessen the effectiveness of existing general purpose pose estimation models. In order to address the lighting variation challenge, infrared selective (IRS) image acquisition technique is proposed to provide uniform quality data under various lighting conditions. In addition, to deal with unconventional pose perspective, a 2-end histogram of oriented gradient (HOG) rectification method is presented. In this work, we explored the idea of employing a pre-trained convolutional neural network (CNN) model trained on large public datasets of general human poses and fine-tuning the model using our own shallow in-bed IRS dataset. We developed an IRS imaging system and collected IRS image data from several realistic life-size mannequins in a simulated hospital room environment. A pre-trained CNN called convolutional pose machine (CPM) was repurposed for in-bed pose estimation by fine-tuning its specific intermediate layers. Using the HOG rectification method, the pose estimation performance of CPM significantly improved by 26.4% in PCK0.1 criteria compared to the model without such rectification.