Deep learning tools for the measurement of animal behavior in neuroscience
Not on the map. Why?
Abstract (arXiv)
Recent advances in computer vision have made accurate, fast and robust measurement of animal behavior a reality. In the past years powerful tools specifically designed to aid the measurement of behavior have come to fruition. Here we discuss how capturing the postures of animals - pose estimation - has been rapidly advancing with new deep learning methods. While challenges still remain, we envision that the fast-paced development of new deep learning tools will rapidly change the landscape of realizable real-world neuroscience.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 5; 2023: 10; 2024: 10; 2025: 5; 2026: 6.
44 papers.
Sort:
By area:
- 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 129
- 2024Empowering Biomedical Discovery with AI Agentscited by 117
- 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 102
- 2022SuperAnimal pretrained pose estimation models for behavioral analysiscited by 38
- 2023MammalNet: A Large-scale Video Benchmark for Mammal Recognition and Behavior Understandingcited by 35
- 2022The Caltech Fish Counting Dataset: A Benchmark for Multiple-Object Tracking and Countingcited by 24
- 2021A Novel Dataset for Keypoint Detection of quadruped Animals from Imagescited by 18
- 20233D-POP -- An automated annotation approach to facilitate markerless 2D-3D tracking of freely moving birds with marker-based motion capturecited by 18
- 2024HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fieldscited by 14
- 2024BaboonLand Dataset: Tracking Primates in the Wild and Automating Behaviour Recognition from Drone Videoscited by 14
- 2025MammAlps: A multi-view video behavior monitoring dataset of wild mammals in the Swiss Alpscited by 14
- 2023Rethinking pose estimation in crowds: overcoming the detection information-bottleneck and ambiguitycited by 13
32 more
- 2023AmadeusGPT: a natural language interface for interactive animal behavioral analysiscited by 12
- 2022OpenApePose: a database of annotated ape photographs for pose estimationcited by 10
- 2024Computer Vision for Primate Behavior Analysis in the Wildcited by 10
- 2021Measuring and modeling the motor system with machine learningcited by 7
- 2024Adaptive Intelligence: leveraging insights from adaptive behavior in animals to build flexible AI systemscited by 5
- 2025Animal behavioral analysis and neural encoding with transformer-based self-supervised pretrainingcited by 5
- 2023CNN-Based Action Recognition and Pose Estimation for Classifying Animal Behavior from Videos: A Surveycited by 4
- 2024Animal Behavior Analysis Methods Using Deep Learning: A Surveycited by 4
- 2021Fast deep learning correspondence for neuron tracking and identification in C.elegans using synthetic trainingcited by 3
- 2021Self-supervised Secondary Landmark Detection via 3D Representation Learningcited by 3
- 2023Insightful analysis of historical sources at scales beyond human capabilities using unsupervised Machine Learning and XAIcited by 3
- 2023Automated Detection of Cat Facial Landmarkscited by 3
- 2026Future of Edge AI in biodiversity monitoringcited by 3
- 2023Automated Behavioral Analysis Using Instance Segmentationcited by 2
- 2021A brain basis of dynamical intelligence for AI and computational neurosciencecited by 1
- 2021Incremental Learning for Animal Pose Estimation using RBF k-DPPcited by 1
- 2023Elephants and Algorithms: A Review of the Current and Future Role of AI in Elephant Monitoringcited by 1
- 2023Of Mice and Pose: 2D Mouse Pose Estimation from Unlabelled Data and Synthetic Priorcited by 1
- 2024Feature-Aware Noise Contrastive Learning for Unsupervised Red Panda Re-Identificationcited by 1
- 2024GatedUniPose: A Novel Approach for Pose Estimation Combining UniRepLKNet and Gated Convolutioncited by 1
- 2024Whole-Herd Elephant Pose Estimation from Drone Data for Collective Behavior Analysiscited by 1
- 2025MBE-ARI: A Multimodal Dataset Mapping Bi-directional Engagement in Animal-Robot Interactioncited by 1
- 2025Towards Application-Specific Evaluation of Vision Models: Case Studies in Ecology and Biologycited by 1
- 2026BigMaQ: A Big Macaque Motion and Animation Dataset Bridging Image and 3D Pose Representationscited by 1
- 2021GUNNEL: Guided Mixup Augmentation and Multi-Model Fusion for Aquatic Animal Segmentationcited by 0
- 2022Integrating Statistical and Machine Learning Approaches to Identify Receptive Field Structure in Neural Populationscited by 0
- 2024ComS2T: A complementary spatiotemporal learning system for data-adaptive model evolutioncited by 0
- 2025From eye to AI: studying rodent social behavior in the era of machine Learningcited by 0
- 2026Rodent-Benchcited by 0
- 2026MSGL-Transformer: A Multi-Scale Global-Local Transformer for Rodent Social Behavior Recognitioncited by 0
- 2026PlayClass: Automated Play Behaviour Classification in Poultrycited by 0
- 2026Sparse-View Interpretable 3D Animal Behavior Representations for Neural Encoding and Decodingcited by 0
- 2026Sparse-View Interpretable 3D Animal Behavior Representations for Neural Encoding and Decoding28 Sep 2026
- 2026PlayClass: Automated Play Behaviour Classification in Poultry26 May 2026
- 2026MSGL-Transformer: A Multi-Scale Global-Local Transformer for Rodent Social Behavior Recognition8 Apr 2026
- 2026BigMaQ: A Big Macaque Motion and Animation Dataset Bridging Image and 3D Pose Representations23 Feb 2026
- 2026Rodent-Bench20 Feb 2026
- 2026Future of Edge AI in biodiversity monitoring13 Feb 2026
- 2025From eye to AI: studying rodent social behavior in the era of machine Learning6 Aug 2025
- 2025Animal behavioral analysis and neural encoding with transformer-based self-supervised pretraining13 Jul 2025
- 2025Towards Application-Specific Evaluation of Vision Models: Case Studies in Ecology and Biology5 May 2025
- 2025MBE-ARI: A Multimodal Dataset Mapping Bi-directional Engagement in Animal-Robot Interaction11 Apr 2025
- 2025MammAlps: A multi-view video behavior monitoring dataset of wild mammals in the Swiss Alps23 Mar 2025
- 2024Adaptive Intelligence: leveraging insights from adaptive behavior in animals to build flexible AI systems21 Nov 2024
32 more
- 2024Whole-Herd Elephant Pose Estimation from Drone Data for Collective Behavior Analysis31 Oct 2024
- 2024GatedUniPose: A Novel Approach for Pose Estimation Combining UniRepLKNet and Gated Convolution12 Sep 2024
- 2024BaboonLand Dataset: Tracking Primates in the Wild and Automating Behaviour Recognition from Drone Videos27 May 2024
- 2024Animal Behavior Analysis Methods Using Deep Learning: A Survey22 May 2024
- 2024Feature-Aware Noise Contrastive Learning for Unsupervised Red Panda Re-Identification1 May 2024
- 2024Empowering Biomedical Discovery with AI Agents3 Apr 2024
- 2024ComS2T: A complementary spatiotemporal learning system for data-adaptive model evolution4 Mar 2024
- 2024HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields26 Feb 2024
- 2024Computer Vision for Primate Behavior Analysis in the Wild29 Jan 2024
- 2023Automated Behavioral Analysis Using Instance Segmentation12 Dec 2023
- 2023Automated Detection of Cat Facial Landmarks15 Oct 2023
- 2023Insightful analysis of historical sources at scales beyond human capabilities using unsupervised Machine Learning and XAI13 Oct 2023
- 2023Of Mice and Pose: 2D Mouse Pose Estimation from Unlabelled Data and Synthetic Prior25 Jul 2023
- 2023AmadeusGPT: a natural language interface for interactive animal behavioral analysis10 Jul 2023
- 2023Elephants and Algorithms: A Review of the Current and Future Role of AI in Elephant Monitoring23 Jun 2023
- 2023Rethinking pose estimation in crowds: overcoming the detection information-bottleneck and ambiguity13 Jun 2023
- 2023MammalNet: A Large-scale Video Benchmark for Mammal Recognition and Behavior Understanding1 Jun 2023
- 20233D-POP -- An automated annotation approach to facilitate markerless 2D-3D tracking of freely moving birds with marker-based motion capture23 Mar 2023
- 2023CNN-Based Action Recognition and Pose Estimation for Classifying Animal Behavior from Videos: A Survey15 Jan 2023
- 2022OpenApePose: a database of annotated ape photographs for pose estimation30 Nov 2022
- 2022Integrating Statistical and Machine Learning Approaches to Identify Receptive Field Structure in Neural Populations25 Jul 2022
- 2022The Caltech Fish Counting Dataset: A Benchmark for Multiple-Object Tracking and Counting19 Jul 2022
- 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understanding18 Apr 2022
- 2022SuperAnimal pretrained pose estimation models for behavioral analysis14 Mar 2022
- 2021GUNNEL: Guided Mixup Augmentation and Multi-Model Fusion for Aquatic Animal Segmentation12 Dec 2021
- 2021Incremental Learning for Animal Pose Estimation using RBF k-DPP26 Oct 2021
- 2021Seeing biodiversity: perspectives in machine learning for wildlife conservation25 Oct 2021
- 2021Self-supervised Secondary Landmark Detection via 3D Representation Learning1 Oct 2021
- 2021A Novel Dataset for Keypoint Detection of quadruped Animals from Images31 Aug 2021
- 2021A brain basis of dynamical intelligence for AI and computational neuroscience15 May 2021
- 2021Measuring and modeling the motor system with machine learning22 Mar 2021
- 2021Fast deep learning correspondence for neuron tracking and identification in C.elegans using synthetic training20 Jan 2021
- 2026Rodent-Benchcited by 0
- 2026Rodent-Bench20 Feb 2026
- 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 129
- 2024Empowering Biomedical Discovery with AI Agentscited by 117
- 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 102
- 2022SuperAnimal pretrained pose estimation models for behavioral analysiscited by 38
- 2023MammalNet: A Large-scale Video Benchmark for Mammal Recognition and Behavior Understandingcited by 35
- 2022The Caltech Fish Counting Dataset: A Benchmark for Multiple-Object Tracking and Countingcited by 24
- 2021A Novel Dataset for Keypoint Detection of quadruped Animals from Imagescited by 18
- 20233D-POP -- An automated annotation approach to facilitate markerless 2D-3D tracking of freely moving birds with marker-based motion capturecited by 18
- 2024HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fieldscited by 14
- 2024BaboonLand Dataset: Tracking Primates in the Wild and Automating Behaviour Recognition from Drone Videoscited by 14
- 2025MammAlps: A multi-view video behavior monitoring dataset of wild mammals in the Swiss Alpscited by 14
- 2023Rethinking pose estimation in crowds: overcoming the detection information-bottleneck and ambiguitycited by 13
12 most cited of 43 All 43 (JSON)
- 2026Sparse-View Interpretable 3D Animal Behavior Representations for Neural Encoding and Decoding28 Sep 2026
- 2026PlayClass: Automated Play Behaviour Classification in Poultry26 May 2026
- 2026MSGL-Transformer: A Multi-Scale Global-Local Transformer for Rodent Social Behavior Recognition8 Apr 2026
- 2026BigMaQ: A Big Macaque Motion and Animation Dataset Bridging Image and 3D Pose Representations23 Feb 2026
- 2026Future of Edge AI in biodiversity monitoring13 Feb 2026
- 2025From eye to AI: studying rodent social behavior in the era of machine Learning6 Aug 2025
- 2025Animal behavioral analysis and neural encoding with transformer-based self-supervised pretraining13 Jul 2025
- 2025Towards Application-Specific Evaluation of Vision Models: Case Studies in Ecology and Biology5 May 2025
- 2025MBE-ARI: A Multimodal Dataset Mapping Bi-directional Engagement in Animal-Robot Interaction11 Apr 2025
- 2025MammAlps: A multi-view video behavior monitoring dataset of wild mammals in the Swiss Alps23 Mar 2025
- 2024Adaptive Intelligence: leveraging insights from adaptive behavior in animals to build flexible AI systems21 Nov 2024
- 2024Whole-Herd Elephant Pose Estimation from Drone Data for Collective Behavior Analysis31 Oct 2024
12 newest of 43 All 43 (JSON)