mlsanityData to 7 Oct 2026

Animal Behavior Analysis Methods Using Deep Learning: A Survey

arXiv 2405.14002 ↗First posted 22 May 2024cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Animal behavior serves as a reliable indicator of the adaptation of organisms to their environment and their overall well-being. Through rigorous observation of animal actions and interactions, researchers and observers can glean valuable insights into diverse facets of their lives, encompassing health, social dynamics, ecological relationships, and neuroethological dimensions. Although state-of-the-art deep learning models have demonstrated remarkable accuracy in classifying various forms of animal data, their adoption in animal behavior studies remains limited. This survey article endeavors to comprehensively explore deep learning architectures and strategies applied to the identification of animal behavior, spanning auditory, visual, and audiovisual methodologies. Furthermore, the manuscript scrutinizes extant animal behavior datasets, offering a detailed examination of the principal challenges confronting this research domain. The article culminates in a comprehensive discussion of key research directions within deep learning that hold potential for advancing the field of animal behavior studies.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 65 of its 225 references that are in the map. First posted on arXiv 22 May 2024.

Builds on

65 of 225 references.

References · 65

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  4. 2017Mask R-CNNcited by 7,259
  5. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  6. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  7. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  8. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  9. 2014Going Deeper with Convolutionscited by 4,231
  10. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  11. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  12. 2016Identity Mappings in Deep Residual Networkscited by 1,960
38 more
  1. 2018SlowFast Networks for Video Recognitioncited by 1,862
  2. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  3. 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
  4. 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
  5. 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
  6. 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 386
  7. 2015Quantized Convolutional Neural Networks for Mobile Devicescited by 212
  8. 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 205
  9. 2018Markerless tracking of user-defined features with deep learningcited by 203
  10. 2016Temporal Convolutional Networks: A Unified Approach to Action Segmentationcited by 199
  11. 2016Grad-CAM: Why did you say that?cited by 159
  12. 2018PersonLab: Person Pose Estimation and Instance Segmentation with a Bottom-Up, Part-Based, Geometric Embedding Modelcited by 133
  13. 2021AP-10K: A Benchmark for Animal Pose Estimation in the Wildcited by 123
  14. 2022Learnable latent embeddings for joint behavioral and neural analysiscited by 113
  15. 2019Cross-Domain Adaptation for Animal Pose Estimationcited by 108
  16. 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 102
  17. 2021Computational bioacoustics with deep learning: a review and roadmapcited by 78
  18. 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
  19. 2022APT-36K: A Large-scale Benchmark for Animal Pose Estimation and Trackingcited by 55
  20. 2019DirectPose: Direct End-to-End Multi-Person Pose Estimationcited by 49
  21. 2019Pretraining boosts out-of-domain robustness for pose estimationcited by 47
  22. 2020Data Boost: Text Data Augmentation Through Reinforcement Learning Guided Conditional Generationcited by 47
  23. 2018Jointly Optimize Data Augmentation and Network Training: Adversarial Data Augmentation in Human Pose Estimationcited by 44
  24. 2019Deep learning tools for the measurement of animal behavior in neurosciencecited by 44
  25. 2018Temporal Gaussian Mixture Layer for Videoscited by 40
  26. 2017Adversarial PoseNet: A Structure-aware Convolutional Network for Human Pose Estimationcited by 35
  27. 2023MammalNet: A Large-scale Video Benchmark for Mammal Recognition and Behavior Understandingcited by 35
  28. 2017Hidden Two-Stream Convolutional Networks for Action Recognitioncited by 24
  29. 2013Mapping the stereotyped behaviour of freely-moving fruit fliescited by 21
  30. 2021T-LEAP: Occlusion-robust pose estimation of walking cows using temporal informationcited by 15
  31. 2015Combining Local Appearance and Holistic View: Dual-Source Deep Neural Networks for Human Pose Estimationcited by 14
  32. 2018NIPS4Bplus: a richly annotated birdsong audio datasetcited by 14
  33. 2023Learning to detect an animal sound from five examplescited by 14
  34. 2023ScarceNet: Animal Pose Estimation with Scarce Annotationscited by 13
  35. 2021Leaving Flatland: Advances in 3D behavioral measurementcited by 10
  36. 2022Multimodal sensor data fusion for in-situ classification of animal behavior using accelerometry and GNSS datacited by 10
  37. 2021Animal behavior classification via deep learning on embedded systemscited by 9
  38. 2017Self Adversarial Training for Human Pose Estimationcited by 8

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.

  1. 2025CISO: Species Distribution Modeling Conditioned on Incomplete Species Observationscited by 1
  2. 2025Mouse Lockbox Dataset: Behavior Recognition for Mice Solving Lockboxescited by 0
  3. 2025Flexible inference for animal learning rules using neural networkscited by 0
  4. 2026MSGL-Transformer: A Multi-Scale Global-Local Transformer for Rodent Social Behavior Recognitioncited by 0