Intelligent Sight and Sound: A Chronic Cancer Pain Dataset
Not on the map. Why?
Abstract (arXiv)
Cancer patients experience high rates of chronic pain throughout the treatment process. Assessing pain for this patient population is a vital component of psychological and functional well-being, as it can cause a rapid deterioration of quality of life. Existing work in facial pain detection often have deficiencies in labeling or methodology that prevent them from being clinically relevant. This paper introduces the first chronic cancer pain dataset, collected as part of the Intelligent Sight and Sound (ISS) clinical trial, guided by clinicians to help ensure that model findings yield clinically relevant results. The data collected to date consists of 29 patients, 509 smartphone videos, 189,999 frames, and self-reported affective and activity pain scores adopted from the Brief Pain Inventory (BPI). Using static images and multi-modal data to predict self-reported pain levels, early models show significant gaps between current methods available to predict pain today, with room for improvement. Due to the especially sensitive nature of the inherent Personally Identifiable Information (PII) of facial images, the dataset will be released under the guidance and control of the National Institutes of Health (NIH).
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 13 of its 95 references that are in the map. First posted on arXiv 7 Apr 2022.
Builds on
13 of 95 references.
References · 13
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
- 2019MediaPipe: A Framework for Building Perception Pipelinescited by 583
- 2019Real-time Facial Surface Geometry from Monocular Video on Mobile GPUscited by 73
- 2016Recurrent Convolutional Neural Network Regression for Continuous Pain Intensity Estimation in Videocited by 12
- 2020Multimodal Spatio-Temporal Deep Learning Approach for Neonatal Postoperative Pain Assessmentcited by 10
- 2019Limitations and Biases in Facial Landmark Detection -- An Empirical Study on Older Adults with Dementiacited by 7
- 2018Automated Pain Detection from Facial Expressions using FACS: A Reviewcited by 6
- 2019Multi-Channel Neural Network for Assessing Neonatal Pain from Videoscited by 6
- 2020The Use of AI for Thermal Emotion Recognition: A Review of Problems and Limitations in Standard Design and Datacited by 6
- 2021Unobtrusive Pain Monitoring in Older Adults with Dementia using Pairwise and Contrastive Trainingcited by 6
- 2018Neonatal Pain Expression Recognition Using Transfer Learningcited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 2.
3 papers.