Deep Neural Network Architecture Search for Accurate Visual Pose Estimation aboard Nano-UAVs
Not on the map. Why?
Abstract (arXiv)
Miniaturized autonomous unmanned aerial vehicles (UAVs) are an emerging and trending topic. With their form factor as big as the palm of one hand, they can reach spots otherwise inaccessible to bigger robots and safely operate in human surroundings. The simple electronics aboard such robots (sub-100mW) make them particularly cheap and attractive but pose significant challenges in enabling onboard sophisticated intelligence. In this work, we leverage a novel neural architecture search (NAS) technique to automatically identify several Pareto-optimal convolutional neural networks (CNNs) for a visual pose estimation task. Our work demonstrates how real-life and field-tested robotics applications can concretely leverage NAS technologies to automatically and efficiently optimize CNNs for the specific hardware constraints of small UAVs. We deploy several NAS-optimized CNNs and run them in closed-loop aboard a 27-g Crazyflie nano-UAV equipped with a parallel ultra-low power System-on-Chip. Our results improve the State-of-the-Art by reducing the in-field control error of 32% while achieving a real-time onboard inference-rate of ~10Hz@10mW and ~50Hz@90mW.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 3 Mar 2023.
Builds on
19 of 26 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2018DARTS: Differentiable Architecture Searchcited by 1,782
- 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 937
- 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 666
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2017Large-Scale Evolution of Image Classifierscited by 348
- 2017Integral Human Pose Regressioncited by 255
- 2020FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensionscited by 152
- 20182D/3D Pose Estimation and Action Recognition using Multitask Deep Learningcited by 103
- 2017MorphNet: Fast & Simple Resource-Constrained Structure Learning of Deep Networkscited by 92
- 2020DORY: Automatic End-to-End Deployment of Real-World DNNs on Low-Cost IoT MCUscited by 57
7 more
- 2021Fully Onboard AI-powered Human-Drone Pose Estimation on Ultra-low Power Autonomous Flying Nano-UAVscited by 24
- 2020Neural-Swarm: Decentralized Close-Proximity Multirotor Control Using Learned Interactionscited by 19
- 2023Lightweight Neural Architecture Search for Temporal Convolutional Networks at the Edgecited by 15
- 2016A near-threshold RISC-V core with DSP extensions for scalable IoT Endpoint Devicescited by 12
- 2019An Open Source and Open Hardware Deep Learning-powered Visual Navigation Engine for Autonomous Nano-UAVscited by 10
- 2020Technical Report: NEMO DNN Quantization for Deployment Modelcited by 5
- 2021Learning-based Bias Correction for Time Difference of Arrival Ultra-wideband Localization of Resource-constrained Mobile Robotscited by 3
Built on by
Citing papers per year: 2024: 3.
3 papers.