Going Deeper than Tracking: a Survey of Computer-Vision Based Recognition of Animal Pain and Affective States
Not on the map. Why?
Abstract (arXiv)
Advances in animal motion tracking and pose recognition have been a game changer in the study of animal behavior. Recently, an increasing number of works go 'deeper' than tracking, and address automated recognition of animals' internal states such as emotions and pain with the aim of improving animal welfare, making this a timely moment for a systematization of the field. This paper provides a comprehensive survey of computer vision-based research on recognition of affective states and pain in animals, addressing both facial and bodily behavior analysis. We summarize the efforts that have been presented so far within this topic -- classifying them across different dimensions, highlight challenges and research gaps, and provide best practice recommendations for advancing the field, and some future directions for research.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 26 of its 140 references that are in the map. First posted on arXiv 16 Jun 2022.
Builds on
26 of 140 references.
References · 26
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2018Disentangling by Factorisingcited by 616
- 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 513
- 2021Deep ViT Features as Dense Visual Descriptorscited by 330
- 2018Deep Facial Expression Recognition: A Surveycited by 270
- 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 241
14 more
- 2018Markerless tracking of user-defined features with deep learningcited by 206
- 2020Overcoming Classifier Imbalance for Long-tail Object Detection with Balanced Group Softmaxcited by 152
- 2019Cross-Domain Adaptation for Animal Pose Estimationcited by 108
- 2020Who Left the Dogs Out? 3D Animal Reconstruction with Expectation Maximization in the Loopcited by 81
- 2018Facial Landmark Detection: a Literature Surveycited by 63
- 2018Survey on Emotional Body Gesture Recognitioncited by 47
- 2019A Deeper Look at Facial Expression Dataset Biascited by 25
- 2014Facial Feature Point Detection: A Comprehensive Surveycited by 13
- 2021Foundations of data imbalance and solutions for a data democracycited by 11
- 2019Dynamics are Important for the Recognition of Equine Pain in Videocited by 8
- 2021Automated Detection of Equine Facial Action Unitscited by 4
- 2021Sharing Pain: Using Pain Domain Transfer for Video Recognition of Low Grade Orthopedic Pain in Horsescited by 2
- 2021Equine Pain Behavior Classification via Self-Supervised Disentangled Pose Representationcited by 2
- 2021Emotion Recognition in Horses with Convolutional Neural Networkscited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 0; 2025: 1.
2 papers.