Real-Time Branch-to-Tool Distance Estimation for Autonomous UAV Pruning: Benchmarking Five DEFOM-Stereo Variants from Simulation to Jetson Deployment
Not on the map. Why?
Abstract (arXiv)
Autonomous tree pruning with unmanned aerial vehicles (UAVs) is a safety-critical real-world task: the onboard perception system must estimate the metric distance from a cutting tool to thin tree branches in real time so that the UAV can approach, align, and actuate the pruner without collision. We address this problem by training five variants of DEFOM-Stereo - a recent foundation-model-based stereo matcher - on a task-specific synthetic dataset and deploying the checkpoints on an NVIDIA Jetson Orin Super 16 GB. The training corpus is built in Unreal Engine 5 with a simulated ZED Mini stereo camera capturing 5,520 stereo pairs across 115 tree instances from three viewpoints at 2m distance; dense EXR depth maps provide exact, spatially complete supervision for thin branches. On the synthetic test set, DEFOM-Stereo ViT-S achieves the best depth-domain accuracy (EPE 1.74 px, D1-all 5.81%, delta-1 95.90%, depth MAE 23.40 cm) but its Jetson inference speed of ~2.2 FPS (~450 ms per frame) remains too slow for responsive closed-loop tool control. A newly introduced balanced variant, DEFOM-PrunePlus (~21M backbone, ~3.3 FPS on Jetson), offers the best deployable accuracy-speed trade-off (EPE 5.87 px, depth MAE 64.26 cm, delta-1 87.59%): its frame rate is sufficient for real-time guidance and its depth accuracy supports safe branch approach planning at the 2m operating range. The lightweight DEFOM-PruneStereo (~6.9 FPS) and DEFOM-PruneNano (~8.5 FPS) run fast but sacrifice substantial accuracy (depth MAE > 57 cm), making estimates too unreliable for safe actuation. Zero-shot inference on real photographs confirms that full-capacity models preserve branch geometry, validating the sim-to-real transfer. We conclude that DEFOM-PrunePlus provides the most practical accuracy-latency balance for onboard distance estimation, while ViT-S serves as the reference for future hardware.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 19 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
14 of 19 references.
References · 14
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2019GhostNet: More Features from Cheap Operationscited by 410
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
- 2019DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatchcited by 114
- 2018Anytime Stereo Image Depth Estimation on Mobile Devicescited by 54
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 52
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 47
- 2025Performance Evaluation of Deep Learning for Tree Branch Segmentation in Autonomous Forestry Systemscited by 7
Built on by
Not cited yet.