Automatic Analysis of Human Body Representations in Western Art
Not on the map. Why?
Abstract (arXiv)
The way the human body is depicted in classical and modern paintings is relevant for art historical analyses. Each artist has certain themes and concerns, resulting in different poses being used more heavily than others. In this paper, we propose a computer vision pipeline to analyse human pose and representations in paintings, which can be used for specific artists or periods. Specifically, we combine two pose estimation approaches (OpenPose and DensePose, respectively) and introduce methods to deal with occlusion and perspective issues. For normalisation, we map the detected poses and contours to Leonardo da Vinci's Vitruvian Man, the classical depiction of body proportions. We propose a visualisation approach for illustrating the articulation of joints in a set of paintings. Combined with a hierarchical clustering of poses, our approach reveals common and uncommon poses used by artists. Our approach improves over purely skeleton based analyses of human body in paintings.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 16 of its 28 references that are in the map. First posted on arXiv 17 Oct 2022.
Builds on
16 of 28 references.
References · 16
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 205
- 2018Survey on Emotional Body Gesture Recognitioncited by 47
- 2021Explain Me the Painting: Multi-Topic Knowledgeable Art Description Generationcited by 30
- 2021Iconographic Image Captioning for Artworkscited by 15
- 2020Enhancing Human Pose Estimation in Ancient Vase Paintings via Perceptually-grounded Style Transfer Learningcited by 13
4 more
- 2019Linking Art through Human Posescited by 9
- 2020Understanding Compositional Structures in Art Historical Images using Pose and Gaze Priorscited by 9
- 2020Visual link retrieval and knowledge discovery in painting datasetscited by 7
- 2021Automatic analysis of artistic paintings using information-based measurescited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1.
2 papers.