HIT-UAV: A high-altitude infrared thermal dataset for Unmanned Aerial Vehicle-based object detection
Not on the map. Why?
Abstract (arXiv)
We present the HIT-UAV dataset, a high-altitude infrared thermal dataset for object detection applications on Unmanned Aerial Vehicles (UAVs). The dataset comprises 2,898 infrared thermal images extracted from 43,470 frames in hundreds of videos captured by UAVs in various scenarios including schools, parking lots, roads, and playgrounds. Moreover, the HIT-UAV provides essential flight data for each image, such as flight altitude, camera perspective, date, and daylight intensity. For each image, we have manually annotated object instances with bounding boxes of two types (oriented and standard) to tackle the challenge of significant overlap of object instances in aerial images. To the best of our knowledge, the HIT-UAV is the first publicly available high-altitude UAV-based infrared thermal dataset for detecting persons and vehicles. We have trained and evaluated well-established object detection algorithms on the HIT-UAV. Our results demonstrate that the detection algorithms perform exceptionally well on the HIT-UAV compared to visual light datasets since infrared thermal images do not contain significant irrelevant information about objects. We believe that the HIT-UAV will contribute to various UAV-based applications and researches. The dataset is freely available at https://github.com/suojiashun/HIT-UAV-Infrared-Thermal-Dataset.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 11 of its 33 references that are in the map. First posted on arXiv 7 Apr 2022.
Builds on
11 of 33 references.
References · 11
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2020Detection and Tracking Meet Drones Challengecited by 263
- 2017Drone-based Object Counting by Spatially Regularized Regional Proposal Networkcited by 156
- 2020Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learningcited by 152
- 2018Vision Meets Drones: A Challengecited by 81
- 2020AU-AIR: A Multi-modal Unmanned Aerial Vehicle Dataset for Low Altitude Traffic Surveillancecited by 56
- 2020Aerial Imagery Pile burn detection using Deep Learning: the FLAME datasetcited by 36
Built on by
Citing papers per year: 2023: 3; 2024: 10; 2025: 9; 2026: 12.
34 papers.
Sort:
By area:
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 101
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 85
- 2023SynDrone -- Multi-modal UAV Dataset for Urban Scenarioscited by 28
- 2025RingMo-Agent: A Unified Remote Sensing Foundation Model for Multi-Platform and Multi-Modal Reasoningcited by 20
- 2024Caltech Aerial RGB-Thermal Dataset in the Wildcited by 19
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2024Self-supervised visual learning in the low-data regime: a comparative evaluationcited by 11
- 2025EarthGPT-X: A Spatial MLLM for Multi-level Multi-Source Remote Sensing Imagery Understanding with Visual Promptingcited by 11
- 2024UVCPNet: A UAV-Vehicle Collaborative Perception Network for 3D Object Detectioncited by 7
- 2024UEMM-Air: Make Unmanned Aerial Vehicles Perform More Multi-modal Taskscited by 4
- 2025SAGA: Semantic-Aware Gray color Augmentation for Visible-to-Thermal Domain Adaptation across Multi-View Drone and Ground-Based Vision Systemscited by 4
22 more
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Taskscited by 4
- 2024Enhanced Vision-Language Models for Diverse Sensor Understanding: Cost-Efficient Optimization and Benchmarkingcited by 3
- 2024Self-Supervised Learning for Real-World Object Detection: a Surveycited by 2
- 2025ODverse33: Is the New YOLO Version Always Better? A Multi Domain benchmark from YOLO v5 to v11cited by 2
- 2025Unlocking Thermal Aerial Imaging: Synthetic Enhancement of UAV Datasetscited by 2
- 2026Task-Guided Prompting for Unified Remote Sensing Image Restorationcited by 2
- 2023Intriguing Property and Counterfactual Explanation of GAN for Remote Sensing Image Generationcited by 1
- 2023A Comprehensive Review of AI-enabled Unmanned Aerial Vehicle: Trends, Vision , and Challengescited by 1
- 2024IndraEye: Infrared Electro-Optical UAV-based Perception Dataset for Robust Downstream Taskscited by 1
- 2025Towards Robust Multi-UAV Collaboration: MARL with Noise-Resilient Communication and Attention Mechanismscited by 1
- 2026FusionRS: A Large-Scale RGB-Infrared-Style Remote Sensing Dataset for Cross-Modal Vision-Language Learningcited by 1
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perceptioncited by 1
- 2025ISTD-YOLO: A Multi-Scale Lightweight High-Performance Infrared Small Target Detection Algorithmcited by 0
- 2025SATGround: A Spatially-Aware Approach for Visual Grounding in Remote Sensingcited by 0
- 2026FlyPose: Towards Robust Human Pose Estimation From Aerial Viewscited by 0
- 2026Hierarchical Dual-Change Collaborative Learning for UAV Scene Change Captioningcited by 0
- 2026Adaptive Slicing-Assisted Hyper Inference for Enhanced Small Object Detection in High-Resolution Imagerycited by 0
- 2026Edge-Aware Thermal Infrared UAV Swarm Trackingcited by 0
- 2026RGB-to-IR image translation for infrared vehicle detection in unseen UAV domainscited by 0
- 2026ReDiffNet: Differential RGB-Infrared Learning for Low-Light UAV Oriented Vehicle Detectioncited by 0
- 2026TIRMamba: A Thermal-Prior-Modulated State-Space Network for Sub-Million-Parameter Infrared Image Super-Resolutioncited by 0
- 2026Can Synthetic UAV Benchmarks Be Trusted? Real-Synthetic Validation for UAV Model Selectioncited by 0
- 2026Can Synthetic UAV Benchmarks Be Trusted? Real-Synthetic Validation for UAV Model Selection10 Oct 2026
- 2026TIRMamba: A Thermal-Prior-Modulated State-Space Network for Sub-Million-Parameter Infrared Image Super-Resolution4 Oct 2026
- 2026ReDiffNet: Differential RGB-Infrared Learning for Low-Light UAV Oriented Vehicle Detection4 Oct 2026
- 2026RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains2 Sep 2026
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception28 Aug 2026
- 2026Edge-Aware Thermal Infrared UAV Swarm Tracking14 Jul 2026
- 2026FusionRS: A Large-Scale RGB-Infrared-Style Remote Sensing Dataset for Cross-Modal Vision-Language Learning15 Jun 2026
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks9 Jun 2026
- 2026Adaptive Slicing-Assisted Hyper Inference for Enhanced Small Object Detection in High-Resolution Imagery21 Apr 2026
- 2026Task-Guided Prompting for Unified Remote Sensing Image Restoration3 Apr 2026
- 2026Hierarchical Dual-Change Collaborative Learning for UAV Scene Change Captioning13 Mar 2026
- 2026FlyPose: Towards Robust Human Pose Estimation From Aerial Views9 Jan 2026
22 more
- 2025SATGround: A Spatially-Aware Approach for Visual Grounding in Remote Sensing9 Dec 2025
- 2025RingMo-Agent: A Unified Remote Sensing Foundation Model for Multi-Platform and Multi-Modal Reasoning28 Jul 2025
- 2025Unlocking Thermal Aerial Imaging: Synthetic Enhancement of UAV Datasets9 Jul 2025
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May 2025
- 2025SAGA: Semantic-Aware Gray color Augmentation for Visible-to-Thermal Domain Adaptation across Multi-View Drone and Ground-Based Vision Systems22 Apr 2025
- 2025ISTD-YOLO: A Multi-Scale Lightweight High-Performance Infrared Small Target Detection Algorithm19 Apr 2025
- 2025EarthGPT-X: A Spatial MLLM for Multi-level Multi-Source Remote Sensing Imagery Understanding with Visual Prompting17 Apr 2025
- 2025Towards Robust Multi-UAV Collaboration: MARL with Noise-Resilient Communication and Attention Mechanisms4 Mar 2025
- 2025ODverse33: Is the New YOLO Version Always Better? A Multi Domain benchmark from YOLO v5 to v1120 Feb 2025
- 2024Enhanced Vision-Language Models for Diverse Sensor Understanding: Cost-Efficient Optimization and Benchmarking30 Dec 2024
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec 2024
- 2024IndraEye: Infrared Electro-Optical UAV-based Perception Dataset for Robust Downstream Tasks28 Oct 2024
- 2024Self-Supervised Learning for Real-World Object Detection: a Survey9 Oct 2024
- 2024UEMM-Air: Make Unmanned Aerial Vehicles Perform More Multi-modal Tasks10 Jun 2024
- 2024UVCPNet: A UAV-Vehicle Collaborative Perception Network for 3D Object Detection7 Jun 2024
- 2024Self-supervised visual learning in the low-data regime: a comparative evaluation26 Apr 2024
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want29 Mar 2024
- 2024Caltech Aerial RGB-Thermal Dataset in the Wild13 Mar 2024
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan 2024
- 2023A Comprehensive Review of AI-enabled Unmanned Aerial Vehicle: Trends, Vision , and Challenges25 Oct 2023
- 2023SynDrone -- Multi-modal UAV Dataset for Urban Scenarios21 Aug 2023
- 2023Intriguing Property and Counterfactual Explanation of GAN for Remote Sensing Image Generation9 Mar 2023
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 101
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 85
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2024Enhanced Vision-Language Models for Diverse Sensor Understanding: Cost-Efficient Optimization and Benchmarkingcited by 3
- 2026FusionRS: A Large-Scale RGB-Infrared-Style Remote Sensing Dataset for Cross-Modal Vision-Language Learningcited by 1
- 2025SATGround: A Spatially-Aware Approach for Visual Grounding in Remote Sensingcited by 0
- 2026FusionRS: A Large-Scale RGB-Infrared-Style Remote Sensing Dataset for Cross-Modal Vision-Language Learning15 Jun 2026
- 2025SATGround: A Spatially-Aware Approach for Visual Grounding in Remote Sensing9 Dec 2025
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May 2025
- 2024Enhanced Vision-Language Models for Diverse Sensor Understanding: Cost-Efficient Optimization and Benchmarking30 Dec 2024
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec 2024
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want29 Mar 2024
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan 2024
- 2023SynDrone -- Multi-modal UAV Dataset for Urban Scenarioscited by 28
- 2025RingMo-Agent: A Unified Remote Sensing Foundation Model for Multi-Platform and Multi-Modal Reasoningcited by 20
- 2024Caltech Aerial RGB-Thermal Dataset in the Wildcited by 19
- 2024Self-supervised visual learning in the low-data regime: a comparative evaluationcited by 11
- 2024UVCPNet: A UAV-Vehicle Collaborative Perception Network for 3D Object Detectioncited by 7
- 2024UEMM-Air: Make Unmanned Aerial Vehicles Perform More Multi-modal Taskscited by 4
- 2025SAGA: Semantic-Aware Gray color Augmentation for Visible-to-Thermal Domain Adaptation across Multi-View Drone and Ground-Based Vision Systemscited by 4
- 2024Self-Supervised Learning for Real-World Object Detection: a Surveycited by 2
- 2025ODverse33: Is the New YOLO Version Always Better? A Multi Domain benchmark from YOLO v5 to v11cited by 2
- 2025Unlocking Thermal Aerial Imaging: Synthetic Enhancement of UAV Datasetscited by 2
- 2026Task-Guided Prompting for Unified Remote Sensing Image Restorationcited by 2
- 2023Intriguing Property and Counterfactual Explanation of GAN for Remote Sensing Image Generationcited by 1
12 most cited of 23 All 23 (JSON)
- 2026Can Synthetic UAV Benchmarks Be Trusted? Real-Synthetic Validation for UAV Model Selection10 Oct 2026
- 2026ReDiffNet: Differential RGB-Infrared Learning for Low-Light UAV Oriented Vehicle Detection4 Oct 2026
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception28 Aug 2026
- 2026Edge-Aware Thermal Infrared UAV Swarm Tracking14 Jul 2026
- 2026Adaptive Slicing-Assisted Hyper Inference for Enhanced Small Object Detection in High-Resolution Imagery21 Apr 2026
- 2026Task-Guided Prompting for Unified Remote Sensing Image Restoration3 Apr 2026
- 2026Hierarchical Dual-Change Collaborative Learning for UAV Scene Change Captioning13 Mar 2026
- 2026FlyPose: Towards Robust Human Pose Estimation From Aerial Views9 Jan 2026
- 2025RingMo-Agent: A Unified Remote Sensing Foundation Model for Multi-Platform and Multi-Modal Reasoning28 Jul 2025
- 2025Unlocking Thermal Aerial Imaging: Synthetic Enhancement of UAV Datasets9 Jul 2025
- 2025SAGA: Semantic-Aware Gray color Augmentation for Visible-to-Thermal Domain Adaptation across Multi-View Drone and Ground-Based Vision Systems22 Apr 2025
- 2025ISTD-YOLO: A Multi-Scale Lightweight High-Performance Infrared Small Target Detection Algorithm19 Apr 2025
12 newest of 23 All 23 (JSON)