mlsanityData to 14 Oct 2026

WildLIFT: Lifting monocular drone video to 3D for species-agnostic wildlife monitoring

arXiv 2604.24718 ↗First posted 27 Apr 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Monocular RGB cameras mounted on drones are widely used for wildlife monitoring, yet most analytical pipelines remain confined to two-dimensional image space, leaving geometric information in video underexploited. We present WildLIFT, a computational framework that integrates three-dimensional scene geometry from monocular drone video with open-vocabulary 2D instance segmentation to enable species-agnostic 3D detection and tracking. Oriented 3D bounding box labels with semantic face information enable quantitative assessment of viewpoint coverage and inter-animal occlusion, producing structured metadata for downstream ecological analyses. We validate the framework on 2,581 manually curated frames comprising over 6,700 3D detections across four large mammal species. WildLIFT maintains high identity consistency in multi-animal scenes and substantially reduces manual 3D annotation effort through keyframe-based refinement. By transforming standard drone footage into structured 3D and viewpoint-aware representations, WildLIFT extends the analytical utility of aerial wildlife datasets for behavioural research and population monitoring.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 63 references that are in the map. First posted on arXiv 27 Apr 2026.

Builds on

25 of 63 references.

References · 25

  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  3. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  4. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  5. 2024Depth Anything V2cited by 1,422
  6. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  7. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
  8. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  9. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
  10. 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
  11. 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
  12. 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
13 more
  1. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
  2. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
  3. 2020Robust Consistent Video Depth Estimationcited by 188
  4. 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 130
  5. 2019Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"cited by 106
  6. 2018Past, Present, and Future Approaches Using Computer Vision for Animal Re-Identification from Camera Trap Datacited by 46
  7. 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 44
  8. 2022SuperAnimal pretrained pose estimation models for behavioral analysiscited by 39
  9. 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 35
  10. 2025Viser: Imperative, Web-based 3D Visualization in Pythoncited by 23
  11. 2020Self-supervised monocular depth estimation from oblique UAV videoscited by 11
  12. 2025Web-Scale Collection of Video Data for 4D Animal Reconstructioncited by 9
  13. 2026LabelAny3D: Label Any Object 3D in the Wildcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.