Deep Learning Computer Vision Algorithms for Real-time UAVs On-board Camera Image Processing
Not on the map. Why?
Abstract (arXiv)
This paper describes how advanced deep learning based computer vision algorithms are applied to enable real-time on-board sensor processing for small UAVs. Four use cases are considered: target detection, classification and localization, road segmentation for autonomous navigation in GNSS-denied zones, human body segmentation, and human action recognition. All algorithms have been developed using state-of-the-art image processing methods based on deep neural networks. Acquisition campaigns have been carried out to collect custom datasets reflecting typical operational scenarios, where the peculiar point of view of a multi-rotor UAV is replicated. Algorithms architectures and trained models performances are reported, showing high levels of both accuracy and inference speed. Output examples and on-field videos are presented, demonstrating models operation when deployed on a GPU-powered commercial embedded device (NVIDIA Jetson Xavier) mounted on board of a custom quad-rotor, paving the way to enabling high level autonomy.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 45 of its 59 references that are in the map. First posted on arXiv 2 Nov 2022.
Builds on
45 of 59 references.
References · 45
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2015Fast R-CNNcited by 2,930
- 2018YOLOv3: An Incremental Improvementcited by 2,652
33 more
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2016YOLO9000: Better, Faster, Strongercited by 1,429
- 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,067
- 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 899
- 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 719
- 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
- 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
- 2018Object Detection with Deep Learning: A Reviewcited by 524
- 2014Long-term Recurrent Convolutional Networks for Visual Recognition and Descriptioncited by 483
- 2015Learning Deconvolution Network for Semantic Segmentationcited by 365
- 2017Road Extraction by Deep Residual U-Netcited by 333
- 2016ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentationcited by 291
- 2019Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentationcited by 258
- 2019High-Resolution Representations for Labeling Pixels and Regionscited by 211
- 2015ParseNet: Looking Wider to See Bettercited by 176
- 2019Gated-SCNN: Gated Shape CNNs for Semantic Segmentationcited by 165
- 2019A Survey of Deep Learning-based Object Detectioncited by 106
- 2021Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenescited by 89
- 2017ActionVLAD: Learning spatio-temporal aggregation for action classificationcited by 73
- 2019FasterSeg: Searching for Faster Real-time Semantic Segmentationcited by 73
- 2015Action Recognition with Trajectory-Pooled Deep-Convolutional Descriptorscited by 58
- 2019Recent Advances in Deep Learning for Object Detectioncited by 50
- 2015Semantic Image Segmentation via Deep Parsing Networkcited by 44
- 2017Light-Head R-CNN: In Defense of Two-Stage Object Detectorcited by 30
- 2016Deep Temporal Linear Encoding Networkscited by 27
- 2019A Review of Object Detection Models based on Convolutional Neural Networkcited by 21
- 2017Lattice Long Short-Term Memory for Human Action Recognitioncited by 16
- 2016Learning long-term dependencies for action recognition with a biologically-inspired deep networkcited by 6
- 2020Foreground-Background Imbalance Problem in Deep Object Detectors: A Reviewcited by 5
- 2019ESNet: An Efficient Symmetric Network for Real-time Semantic Segmentationcited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.