A Review on Deep Learning in UAV Remote Sensing
Not on the map. Why?
Abstract (arXiv)
Deep Neural Networks (DNNs) learn representation from data with an impressive capability, and brought important breakthroughs for processing images, time-series, natural language, audio, video, and many others. In the remote sensing field, surveys and literature revisions specifically involving DNNs algorithms' applications have been conducted in an attempt to summarize the amount of information produced in its subfields. Recently, Unmanned Aerial Vehicles (UAV) based applications have dominated aerial sensing research. However, a literature revision that combines both "deep learning" and "UAV remote sensing" thematics has not yet been conducted. The motivation for our work was to present a comprehensive review of the fundamentals of Deep Learning (DL) applied in UAV-based imagery. We focused mainly on describing classification and regression techniques used in recent applications with UAV-acquired data. For that, a total of 232 papers published in international scientific journal databases was examined. We gathered the published material and evaluated their characteristics regarding application, sensor, and technique used. We relate how DL presents promising results and has the potential for processing tasks associated with UAV-based image data. Lastly, we project future perspectives, commentating on prominent DL paths to be explored in the UAV remote sensing field. Our revision consists of a friendly-approach to introduce, commentate, and summarize the state-of-the-art in UAV-based image applications with DNNs algorithms in diverse subfields of remote sensing, grouping it in the environmental, urban, and agricultural contexts.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 95 of its 241 references that are in the map. First posted on arXiv 22 Jan 2021.
Builds on
95 of 241 references.
References · 95
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2017Mask R-CNNcited by 7,277
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
38 more
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2014Going Deeper with Convolutionscited by 4,241
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2019Searching for MobileNetV3cited by 1,994
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2019Contrastive Multiview Codingcited by 1,301
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
- 2019A Comprehensive Survey on Transfer Learningcited by 1,160
- 2016An overview of gradient descent optimization algorithmscited by 1,033
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,028
- 2020Designing Network Design Spacescited by 960
- 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 849
- 2018Panoptic Segmentationcited by 802
- 2018Path Aggregation Network for Instance Segmentationcited by 798
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
- 2014Deep Learning in Neural Networks: An Overviewcited by 770
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 734
- 2020Image Segmentation Using Deep Learning: A Surveycited by 660
- 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
- 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 554
- 2019Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selectioncited by 540
- 2015Towards Open Set Deep Networkscited by 538
- 2018Object Detection with Deep Learning: A Reviewcited by 528
- 2019Hybrid Task Cascade for Instance Segmentationcited by 481
- 2019Res2Net: A New Multi-scale Backbone Architecturecited by 470
- 2020ResNeSt: Split-Attention Networkscited by 445
- 2019PointRend: Image Segmentation as Renderingcited by 440
- 2019Cascade R-CNN: High Quality Object Detection and Instance Segmentationcited by 429
- 2018A Survey on Deep Transfer Learningcited by 419
50 most cited of 95 All 95 (JSON)
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 10; 2024: 7; 2025: 6; 2026: 2.
32 papers.
Sort:
By area:
- 2023The Segment Anything Model (SAM) for Remote Sensing Applications: From Zero to One Shotcited by 83
- 2023Semantic Segmentation using Vision Transformers: A surveycited by 73
- 2023VDD: Varied Drone Dataset for Semantic Segmentationcited by 40
- 2021Deep Learning for UAV-based Object Detection and Tracking: A Surveycited by 33
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodalitycited by 19
- 2023The Potential of Visual ChatGPT For Remote Sensingcited by 10
- 2023An Informative Path Planning Framework for Active Learning in UAV-based Semantic Mappingcited by 8
- 2022AiTLAS: Artificial Intelligence Toolbox for Earth Observationcited by 7
- 2024PalmProbNet: A Probabilistic Approach to Understanding Palm Distributions in Ecuadorian Tropical Forest via Transfer Learningcited by 5
- 2024Navigation in a simplified Urban Flow through Deep Reinforcement Learningcited by 5
- 2024UEMM-Air: Make Unmanned Aerial Vehicles Perform More Multi-modal Taskscited by 4
- 2022Investigation of Factorized Optical Flows as Mid-Level Representationscited by 2
20 more
- 2022LOANet: A Lightweight Network Using Object Attention for Extracting Buildings and Roads from UAV Aerial Remote Sensing Imagescited by 2
- 2024An evaluation of Deep Learning based stereo dense matching dataset shift from aerial images and a large scale stereo datasetcited by 2
- 2024Semantic Segmentation of Unmanned Aerial Vehicle Remote Sensing Images using SegFormercited by 2
- 2025Machine learning applications in archaeological practices: a reviewcited by 2
- 2025AD-Det: Boosting Object Detection in UAV Images with Focused Small Objects and Balanced Tail Classescited by 2
- 2025FPGA-Enabled Machine Learning Applications in Earth Observation: A Systematic Reviewcited by 2
- 2025Unlocking Thermal Aerial Imaging: Synthetic Enhancement of UAV Datasetscited by 2
- 2021A Deep Learning Approach Based on Graphs to Detect Plantation Linescited by 1
- 2022Exploiting Digital Surface Models for Inferring Super-Resolution for Remotely Sensed Imagescited by 1
- 2023A generic self-supervised learning (SSL) framework for representation learning from spectra-spatial feature of unlabeled remote sensing imagerycited by 1
- 2023A Comprehensive Review on Tree Detection Methods Using Point Cloud and Aerial Imagery from Unmanned Aerial Vehiclescited by 1
- 2024DeepAAT: Deep Automated Aerial Triangulation for Fast UAV-based Mappingcited by 1
- 2024Deep Learning Enhanced Road Traffic Analysis: Scalable Vehicle Detection and Velocity Estimation Using PlanetScope Imagerycited by 1
- 2026A Review of Vision-Based Vehicle Detection for UAV-Based Traffic Monitoring: Experimental Insights and Future Directionscited by 1
- 2022Land Classification in Satellite Images by Injecting Traditional Features to CNN Modelscited by 0
- 2023RemoteNet: Remote Sensing Image Segmentation Network based on Global-Local Informationcited by 0
- 2023Automatic detection of aerial survey ground control points based on Yolov5-OBBcited by 0
- 2023SuperpixelGraph: Semi-automatic generation of building footprint through semantic-sensitive superpixel and neural graph networkscited by 0
- 2025Navigation in a Three-Dimensional Urban Flow using Deep Reinforcement Learningcited by 0
- 2026Mixture-of-Experts in Remote Sensing: A Surveycited by 0
- 2026A Review of Vision-Based Vehicle Detection for UAV-Based Traffic Monitoring: Experimental Insights and Future Directions4 Aug 2026
- 2026Mixture-of-Experts in Remote Sensing: A Survey3 Apr 2026
- 2025Navigation in a Three-Dimensional Urban Flow using Deep Reinforcement Learning29 Oct 2025
- 2025Unlocking Thermal Aerial Imaging: Synthetic Enhancement of UAV Datasets9 Jul 2025
- 2025FPGA-Enabled Machine Learning Applications in Earth Observation: A Systematic Review4 Jun 2025
- 2025AD-Det: Boosting Object Detection in UAV Images with Focused Small Objects and Balanced Tail Classes8 Apr 2025
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodality28 Mar 2025
- 2025Machine learning applications in archaeological practices: a review7 Jan 2025
- 2024Deep Learning Enhanced Road Traffic Analysis: Scalable Vehicle Detection and Velocity Estimation Using PlanetScope Imagery4 Oct 2024
- 2024Semantic Segmentation of Unmanned Aerial Vehicle Remote Sensing Images using SegFormer1 Oct 2024
- 2024Navigation in a simplified Urban Flow through Deep Reinforcement Learning26 Sep 2024
- 2024UEMM-Air: Make Unmanned Aerial Vehicles Perform More Multi-modal Tasks10 Jun 2024
20 more
- 2024PalmProbNet: A Probabilistic Approach to Understanding Palm Distributions in Ecuadorian Tropical Forest via Transfer Learning5 Mar 2024
- 2024An evaluation of Deep Learning based stereo dense matching dataset shift from aerial images and a large scale stereo dataset19 Feb 2024
- 2024DeepAAT: Deep Automated Aerial Triangulation for Fast UAV-based Mapping2 Feb 2024
- 2023A Comprehensive Review on Tree Detection Methods Using Point Cloud and Aerial Imagery from Unmanned Aerial Vehicles28 Sep 2023
- 2023The Segment Anything Model (SAM) for Remote Sensing Applications: From Zero to One Shot29 Jun 2023
- 2023A generic self-supervised learning (SSL) framework for representation learning from spectra-spatial feature of unlabeled remote sensing imagery27 Jun 2023
- 2023VDD: Varied Drone Dataset for Semantic Segmentation23 May 2023
- 2023Semantic Segmentation using Vision Transformers: A survey5 May 2023
- 2023The Potential of Visual ChatGPT For Remote Sensing25 Apr 2023
- 2023SuperpixelGraph: Semi-automatic generation of building footprint through semantic-sensitive superpixel and neural graph networks12 Apr 2023
- 2023Automatic detection of aerial survey ground control points based on Yolov5-OBB6 Mar 2023
- 2023RemoteNet: Remote Sensing Image Segmentation Network based on Global-Local Information25 Feb 2023
- 2023An Informative Path Planning Framework for Active Learning in UAV-based Semantic Mapping7 Feb 2023
- 2022LOANet: A Lightweight Network Using Object Attention for Extracting Buildings and Roads from UAV Aerial Remote Sensing Images16 Dec 2022
- 2022Land Classification in Satellite Images by Injecting Traditional Features to CNN Models21 Jul 2022
- 2022Exploiting Digital Surface Models for Inferring Super-Resolution for Remotely Sensed Images9 May 2022
- 2022Investigation of Factorized Optical Flows as Mid-Level Representations9 Mar 2022
- 2022AiTLAS: Artificial Intelligence Toolbox for Earth Observation21 Jan 2022
- 2021Deep Learning for UAV-based Object Detection and Tracking: A Survey25 Oct 2021
- 2021A Deep Learning Approach Based on Graphs to Detect Plantation Lines5 Feb 2021
- 2026Mixture-of-Experts in Remote Sensing: A Surveycited by 0
- 2026Mixture-of-Experts in Remote Sensing: A Survey3 Apr 2026
- 2023The Segment Anything Model (SAM) for Remote Sensing Applications: From Zero to One Shotcited by 83
- 2023Semantic Segmentation using Vision Transformers: A surveycited by 73
- 2023VDD: Varied Drone Dataset for Semantic Segmentationcited by 40
- 2021Deep Learning for UAV-based Object Detection and Tracking: A Surveycited by 33
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodalitycited by 19
- 2023The Potential of Visual ChatGPT For Remote Sensingcited by 10
- 2023An Informative Path Planning Framework for Active Learning in UAV-based Semantic Mappingcited by 8
- 2022AiTLAS: Artificial Intelligence Toolbox for Earth Observationcited by 7
- 2024PalmProbNet: A Probabilistic Approach to Understanding Palm Distributions in Ecuadorian Tropical Forest via Transfer Learningcited by 5
- 2024UEMM-Air: Make Unmanned Aerial Vehicles Perform More Multi-modal Taskscited by 4
- 2022Investigation of Factorized Optical Flows as Mid-Level Representationscited by 2
- 2022LOANet: A Lightweight Network Using Object Attention for Extracting Buildings and Roads from UAV Aerial Remote Sensing Imagescited by 2
12 most cited of 29 All 29 (JSON)
- 2026A Review of Vision-Based Vehicle Detection for UAV-Based Traffic Monitoring: Experimental Insights and Future Directions4 Aug 2026
- 2025Unlocking Thermal Aerial Imaging: Synthetic Enhancement of UAV Datasets9 Jul 2025
- 2025FPGA-Enabled Machine Learning Applications in Earth Observation: A Systematic Review4 Jun 2025
- 2025AD-Det: Boosting Object Detection in UAV Images with Focused Small Objects and Balanced Tail Classes8 Apr 2025
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodality28 Mar 2025
- 2025Machine learning applications in archaeological practices: a review7 Jan 2025
- 2024Deep Learning Enhanced Road Traffic Analysis: Scalable Vehicle Detection and Velocity Estimation Using PlanetScope Imagery4 Oct 2024
- 2024Semantic Segmentation of Unmanned Aerial Vehicle Remote Sensing Images using SegFormer1 Oct 2024
- 2024UEMM-Air: Make Unmanned Aerial Vehicles Perform More Multi-modal Tasks10 Jun 2024
- 2024PalmProbNet: A Probabilistic Approach to Understanding Palm Distributions in Ecuadorian Tropical Forest via Transfer Learning5 Mar 2024
- 2024An evaluation of Deep Learning based stereo dense matching dataset shift from aerial images and a large scale stereo dataset19 Feb 2024
- 2024DeepAAT: Deep Automated Aerial Triangulation for Fast UAV-based Mapping2 Feb 2024
12 newest of 29 All 29 (JSON)