DeTrack: A Benchmark and Altitude-Aware Dual World Model for Drone-embodied Tracking
On the map: World models → World models for navigation
Abstract (arXiv)
Aerial object tracking has broad applications in public safety, emergency rescue, wildlife monitoring, and related fields. However, existing aerial tracking benchmarks are mainly based on passive 2D video sequences captured from fixed camera locations or predefined flight paths, where drones are treated as passive cameras rather than embodied agents that actively perceive, interact, and control their motion in dynamic 3D scenes. In this paper, we define a new drone-embodied tracking task, termed DeTrack, which requires a drone to track a target in interactive 3D environments using online egocentric observations and active flight control in a closed loop. We build a large-scale benchmark containing 11,368 target trajectories across diverse scenes, rendering conditions, semantic regions, and moving distractors, together with evaluation metrics for target visibility, tracking accuracy, and trajectory success. We further propose AaDWorlds, an altitude-aware dual world model framework for drone-embodied tracking. AaDWorlds consists of an altitude-aware perception module and dual world models that imagine future states under both high- and low-altitude regimes. By combining pseudo altitude-aware observations and imagined future states, AaDWorlds alleviates the intrinsic altitude-mediated contradiction between target visibility and flight safety. Experiments on the DeTrack benchmark demonstrate that AaDWorlds improves closed-loop tracking performance across all evaluation metrics.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 5 of its 37 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
5 of 37 references.
References · 5
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2020Detection and Tracking Meet Drones Challengecited by 261
- 2018Vision Meets Drones: A Challengecited by 80
- 2019Deep Reinforcement Learning for UAV Navigation Through Massive MIMO Techniquecited by 9
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Skytopia: Monocular Drone Navigation with Action-Conditioned Latent World Models
- 2026UAV-Track VLA: Embodied Aerial Tracking via Vision-Language-Action Models
- 2026DroneWAM: Efficient World Action Model for Drone Visual Navigation
- 2025AirScape: An Aerial Generative World Model with Motion Controllability
- 2026Perception-to-Pursuit: Track-Centric Temporal Reasoning for Open-World Drone Detection and Autonomous Chasing
- 2025FlightDiffusion: Revolutionising Autonomous Drone Training with Diffusion Models Generating FPV Video
- 2026MotionScape: A Motion-Stratified UAV Video Benchmark for World Modeling and Future Video Generation
- 2026CosFly-Track: A Large-Scale Multi-Modal Dataset for UAV Visual Tracking via Multi-Constraint Trajectory Optimization