# Leaving Flatland: Advances in 3D behavioral measurement

arXiv: https://arxiv.org/abs/2112.01987 · HTML: https://mlsanity.com/paper/2112.01987/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Dec 2021.

## Built on by (most cited first, 10 of 10)

- [Generative Zoo](https://mlsanity.com/paper/2412.08101/) (2024)
- [OpenApePose: a database of annotated ape photographs for pose estimation](https://mlsanity.com/paper/2212.00741/) (2022)
- [BKinD-3D: Self-Supervised 3D Keypoint Discovery from Multi-View Videos](https://mlsanity.com/paper/2212.07401/) (2022)
- [Learning Behavior Representations Through Multi-Timescale Bootstrapping](https://mlsanity.com/paper/2206.07041/) (2022)
- [CNN-Based Action Recognition and Pose Estimation for Classifying Animal Behavior from Videos: A Survey](https://mlsanity.com/paper/2301.06187/) (2023)
- [Relax, it doesn't matter how you get there: A new self-supervised approach for multi-timescale behavior analysis](https://mlsanity.com/paper/2303.08811/) (2023)
- [Animal Behavior Analysis Methods Using Deep Learning: A Survey](https://mlsanity.com/paper/2405.14002/) (2024)
- [Pose Splatter: A 3D Gaussian Splatting Model for Quantifying Animal Pose and Appearance](https://mlsanity.com/paper/2505.18342/) (2025)
- [BEAST3D: Animal behavioral analysis and neural encoding from multi-view video via Gaussian splatting](https://mlsanity.com/paper/2606.02937/) (2026)
- [Sparse-View Interpretable 3D Animal Behavior Representations for Neural Encoding and Decoding](https://mlsanity.com/paper/2609.36217/) (2026)

## Abstract (arXiv)

Animals move in three dimensions (3D). Thus, 3D measurement is necessary to report the true kinematics of animal movement. Existing 3D measurement techniques draw on specialized hardware, such as motion capture or depth cameras, as well as deep multi-view and monocular computer vision. Continued advances at the intersection of deep learning and computer vision will facilitate 3D tracking across more anatomical features, with less training data, in additional species, and within more natural, occlusive environments. 3D behavioral measurement enables unique applications in phenotyping, investigating the neural basis of behavior, and designing artificial agents capable of imitating animal behavior.