mlsanityData to 14 Oct 2026

NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments

arXiv 2506.18689 ↗First posted 23 Jun 2025cs.RO cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Autonomous aerial target tracking in unstructured and GPS-denied environments remains a fundamental challenge in robotics. Many existing methods rely on motion capture systems, pre-mapped scenes, or feature-based localization to ensure safety and control, limiting their deployment in real-world conditions. We introduce NOVA, a fully onboard, object-centric framework that enables robust target tracking and collision-aware navigation using only a stereo camera and an IMU. Rather than constructing a global map or relying on absolute localization, NOVA formulates perception, estimation, and control entirely in the target's reference frame. A tightly integrated stack combines a lightweight object detector with stereo depth completion, followed by histogram-based filtering to infer robust target distances under occlusion and noise. These measurements feed a visual-inertial state estimator that recovers the full 6-DoF pose of the robot relative to the target. A nonlinear model predictive controller (NMPC) plans dynamically feasible trajectories in the target frame. To ensure safety, high-order control barrier functions are constructed online from a compact set of high-risk collision points extracted from depth, enabling real-time obstacle avoidance without maps or dense representations. We validate NOVA across challenging real-world scenarios, including urban mazes, forest trails, and repeated transitions through buildings with intermittent GPS loss and severe lighting changes that disrupt feature-based localization. Each experiment is repeated multiple times under similar conditions to assess resilience, showing consistent and reliable performance. NOVA achieves agile target following at speeds exceeding 50 km/h. These results show that high-speed vision-based tracking is possible in the wild using only onboard sensing, with no reliance on external localization or environment assumptions.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 32 of its 85 references that are in the map. First posted on arXiv 23 Jun 2025.

Builds on

32 of 85 references.

References · 32

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  4. 2024Depth Anything V2cited by 1,422
  5. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
  6. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
  7. 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 533
  8. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
  9. 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
  10. 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 423
  11. 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
  12. 2019acados: a modular open-source framework for fast embedded optimal controlcited by 68
20 more
  1. 2024RTAB-Map as an Open-Source Lidar and Visual SLAM Library for Large-Scale and Long-Term Online Operationcited by 62
  2. 2021Opening up Open-World Trackingcited by 50
  3. 2022A Benchmark Comparison of Learned Control Policies for Agile Quadrotor Flightcited by 47
  4. 2021NeuroBEM: Hybrid Aerodynamic Quadrotor Modelcited by 37
  5. 2025YOLOE: Real-Time Seeing Anythingcited by 36
  6. 2023Follow Anything: Open-set detection, tracking, and following in real-timecited by 29
  7. 2022Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate Model Predictive Trajectory Trackingcited by 18
  8. 2019Visual-Inertial Odometry of Aerial Robotscited by 14
  9. 2020Nonlinear MPC for Collision Avoidance and Controlof UAVs With Dynamic Obstaclescited by 14
  10. 2022Active Learning of Discrete-Time Dynamics for Uncertainty-Aware Model Predictive Controlcited by 13
  11. 2023Unifying Foundation Models with Quadrotor Control for Visual Tracking Beyond Object Categoriescited by 9
  12. 2024Autonomous Driving in Unstructured Environments: How Far Have We Come?cited by 7
  13. 2021AutoTune: Controller Tuning for High-Speed Flightcited by 5
  14. 2024Reactive Collision Avoidance for Safe Agile Navigationcited by 4
  15. 2023GaPT: Gaussian Process Toolkit for Online Regression with Application to Learning Quadrotor Dynamicscited by 3
  16. 2023CoNi-MPC: Cooperative Non-inertial Frame Based Model Predictive Controlcited by 2
  17. 2023Exploring Deep Reinforcement Learning for Robust Target Tracking using Micro Aerial Vehiclescited by 2
  18. 2024Degradation Resilient LiDAR-Radar-Inertial Odometrycited by 2
  19. 2019UAV/UGV Autonomous Cooperation: UAV Assists UGV to Climb a Cliff by Attaching a Tethercited by 1
  20. 2024Aerial Field Roboticscited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.