mlsanityData to 14 Oct 2026

WildBox: A Dataset and Benchmark for Aerial Monocular 3D Detection of African Savanna Wildlife

arXiv 2606.21309 ↗First posted 19 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce WildBox, a dataset and benchmark for monocular 3D detection of wildlife from drone video, comprising 237,505 3D bounding box annotations across seven African savanna species grouped into six benchmark classes. Annotations follow a KITTI/Omni3D-compatible format in a per-segment scale-normalised camera frame, with instance identities maintained across each segment. We evaluate two open-vocabulary monocular 3D architectures, OVMono3D-LIFT and DetAny3D, under zero-shot, ground-truth 2D box prompt, and supervised fine-tuning protocols. Open-vocabulary 2D foundation models provide usable zero-shot wildlife localisation (50.55 AP@50), but zero-shot 3D detection collapses to 0.00 AP across both architectures and every 2D-input condition tested, including ground-truth 2D box prompts, thus isolating the failure to the 3D stage. Fine-tuning on WildBox recovers performance to 8.68 +/- 0.47 [email protected] and 13.17 +/- 0.69 AP3D macro. Depth contributes 84% of normalised Hausdorff distance after fine-tuning and over 99% in zero-shot, identifying monocular aerial depth as the dominant open problem in this regime. A coarse-to-fine curriculum, i.e. pretraining on a merged zebra class before fine-tuning on the Grevy's/plains split, improves macro 3D performance with less total compute, with the largest gains on the two zebra subclasses. WildBox is released with video-level splits, evaluation code, and baseline checkpoints to enable progress in 3D wildlife perception from drone video.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 51 references that are in the map. First posted on arXiv 19 Jun 2026.

Builds on

29 of 51 references.

References · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  7. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
  8. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  9. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  10. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
  11. 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 160
  12. 2020Objectron: A Large Scale Dataset of Object-Centric Videos in the Wild with Pose Annotationscited by 155
17 more
  1. 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 130
  2. 2019Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"cited by 106
  3. 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 44
  4. 2025Detect Anything 3D in the Wildcited by 33
  5. 2021AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wildcited by 30
  6. 2024Open Vocabulary Monocular 3D Object Detectioncited by 23
  7. 20233D-POP -- An automated annotation approach to facilitate markerless 2D-3D tracking of freely moving birds with marker-based motion capturecited by 18
  8. 2024BaboonLand Dataset: Tracking Primates in the Wild and Automating Behaviour Recognition from Drone Videoscited by 14
  9. 2024BuckTales : A multi-UAV dataset for multi-object tracking and re-identification of wild antelopescited by 14
  10. 2023GRADE: Generating Realistic And Dynamic Environments for Robotics Research with Isaac Simcited by 7
  11. 2023Synthetic Data-based Detection of Zebras in Drone Imagerycited by 6
  12. 2026LabelAny3D: Label Any Object 3D in the Wildcited by 6
  13. 2024POLO -- Point-based, multi-class animal detectioncited by 5
  14. 2025WildLive: Near Real-time Visual Wildlife Tracking onboard UAVscited by 5
  15. 2026MOO: A Multi-view Oriented Observations Dataset for Viewpoint Analysis in Cattle Re-Identificationcited by 3
  16. 2024Adapting the re-ID challenge for static sensorscited by 1
  17. 2026WildLIFT: Lifting monocular drone video to 3D for species-agnostic wildlife monitoringcited by 1

Built on by

Not cited yet.