# Deep learning tools for the measurement of animal behavior in neuroscience

arXiv: https://arxiv.org/abs/1909.13868 · HTML: https://mlsanity.com/paper/1909.13868/

## Key facts

- Cited by 44 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Sep 2019.

## Built on by (most cited first, 30 of 44)

- [Seeing biodiversity: perspectives in machine learning for wildlife conservation](https://mlsanity.com/paper/2110.12951/) (2021)
- [Empowering Biomedical Discovery with AI Agents](https://mlsanity.com/paper/2404.02831/) (2024)
- [Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understanding](https://mlsanity.com/paper/2204.08129/) (2022)
- [SuperAnimal pretrained pose estimation models for behavioral analysis](https://mlsanity.com/paper/2203.07436/) (2022)
- [MammalNet: A Large-scale Video Benchmark for Mammal Recognition and Behavior Understanding](https://mlsanity.com/paper/2306.00576/) (2023)
- [The Caltech Fish Counting Dataset: A Benchmark for Multiple-Object Tracking and Counting](https://mlsanity.com/paper/2207.09295/) (2022)
- [A Novel Dataset for Keypoint Detection of quadruped Animals from Images](https://mlsanity.com/paper/2108.13958/) (2021)
- [3D-POP -- An automated annotation approach to facilitate markerless 2D-3D tracking of freely moving birds with marker-based motion capture](https://mlsanity.com/paper/2303.13174/) (2023)
- [HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields](https://mlsanity.com/paper/2402.17062/) (2024)
- [BaboonLand Dataset: Tracking Primates in the Wild and Automating Behaviour Recognition from Drone Videos](https://mlsanity.com/paper/2405.17698/) (2024)
- [MammAlps: A multi-view video behavior monitoring dataset of wild mammals in the Swiss Alps](https://mlsanity.com/paper/2503.18223/) (2025)
- [Rethinking pose estimation in crowds: overcoming the detection information-bottleneck and ambiguity](https://mlsanity.com/paper/2306.07879/) (2023)
- [AmadeusGPT: a natural language interface for interactive animal behavioral analysis](https://mlsanity.com/paper/2307.04858/) (2023)
- [OpenApePose: a database of annotated ape photographs for pose estimation](https://mlsanity.com/paper/2212.00741/) (2022)
- [Computer Vision for Primate Behavior Analysis in the Wild](https://mlsanity.com/paper/2401.16424/) (2024)
- [Measuring and modeling the motor system with machine learning](https://mlsanity.com/paper/2103.11775/) (2021)
- [Adaptive Intelligence: leveraging insights from adaptive behavior in animals to build flexible AI systems](https://mlsanity.com/paper/2411.15234/) (2024)
- [Animal behavioral analysis and neural encoding with transformer-based self-supervised pretraining](https://mlsanity.com/paper/2507.09513/) (2025)
- [CNN-Based Action Recognition and Pose Estimation for Classifying Animal Behavior from Videos: A Survey](https://mlsanity.com/paper/2301.06187/) (2023)
- [Animal Behavior Analysis Methods Using Deep Learning: A Survey](https://mlsanity.com/paper/2405.14002/) (2024)
- [Fast deep learning correspondence for neuron tracking and identification in C.elegans using synthetic training](https://mlsanity.com/paper/2101.08211/) (2021)
- [Self-supervised Secondary Landmark Detection via 3D Representation Learning](https://mlsanity.com/paper/2110.00543/) (2021)
- [Insightful analysis of historical sources at scales beyond human capabilities using unsupervised Machine Learning and XAI](https://mlsanity.com/paper/2310.09091/) (2023)
- [Automated Detection of Cat Facial Landmarks](https://mlsanity.com/paper/2310.09793/) (2023)
- [Future of Edge AI in biodiversity monitoring](https://mlsanity.com/paper/2602.13496/) (2026)
- [Automated Behavioral Analysis Using Instance Segmentation](https://mlsanity.com/paper/2312.07723/) (2023)
- [A brain basis of dynamical intelligence for AI and computational neuroscience](https://mlsanity.com/paper/2105.07284/) (2021)
- [Incremental Learning for Animal Pose Estimation using RBF k-DPP](https://mlsanity.com/paper/2110.13598/) (2021)
- [Elephants and Algorithms: A Review of the Current and Future Role of AI in Elephant Monitoring](https://mlsanity.com/paper/2306.13803/) (2023)
- [Of Mice and Pose: 2D Mouse Pose Estimation from Unlabelled Data and Synthetic Prior](https://mlsanity.com/paper/2307.13361/) (2023)

## Abstract (arXiv)

Recent advances in computer vision have made accurate, fast and robust measurement of animal behavior a reality. In the past years powerful tools specifically designed to aid the measurement of behavior have come to fruition. Here we discuss how capturing the postures of animals - pose estimation - has been rapidly advancing with new deep learning methods. While challenges still remain, we envision that the fast-paced development of new deep learning tools will rapidly change the landscape of realizable real-world neuroscience.