A Comprehensive Evaluation of Deep Learning Object Detection Models on Heterogeneous Edge Devices
Not on the map. Why?
Abstract (arXiv)
Modern applications such as autonomous vehicles, intelligent surveillance, and smart city systems increasingly require object detection on resource-constrained edge devices. Yet, there is still limited understanding of how different object detection models behave across heterogeneous edge devices and under varying scene complexity. In this paper, we benchmark YOLOv8 (Nano, Small, Medium), EfficientDet Lite (Lite0, Lite1, Lite2), and SSD (SSD MobileNet V1, SSDLite MobileDet) on Raspberry Pi 3, 4, 5 with/without Coral TPU accelerators, Raspberry Pi 5 with AI HAT+, Jetson Nano, and Jetson Orin Nano. We evaluate energy consumption, inference time, and accuracy, and further examine how accuracy changes with the number of objects in the input image. The results reveal clear trade-offs among accuracy, latency, and energy efficiency across model-device combinations. SSD MobileNet V1 achieves the lowest latency and energy consumption but the lowest accuracy, whereas YOLOv8 Medium achieves the highest accuracy at higher computational cost. TPU-based Raspberry Pi devices improve the efficiency of SSD and EfficientDet Lite while reducing YOLOv8 accuracy. Orin Nano offers the most favorable overall balance across most model families. The object-count-based analysis further shows that models achieve more similar accuracy on simpler images, while the accuracy gap widens as scene complexity increases.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 10 of its 30 references that are in the map. First posted on arXiv 25 Sep 2024.
Builds on
10 of 30 references.
References · 10
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
- 2020MobileDets: Searching for Object Detection Architectures for Mobile Acceleratorscited by 55
- 2021DeepEdgeBench: Benchmarking Deep Neural Networks on Edge Devicescited by 26
- 2022Object Detection in Autonomous Vehicles: Status and Open Challengescited by 14
- 2022Benchmarking Edge Computing Devices for Grape Bunches and Trunks Detection using Accelerated Object Detection Single Shot MultiBox Deep Learning Modelscited by 6
Built on by
Citing papers per year: 2025: 4; 2026: 2.
6 papers.
- 2025Designing Object Detection Models for TinyML: Foundations, Comparative Analysis, Challenges, and Emerging Solutionscited by 1
- 2025A Comprehensive Evaluation of YOLO-based Deer Detection Performance on Edge Devicescited by 1
- 2025Development and Testing for Perception Based Autonomous Landing of a Long-Range QuadPlanecited by 1
- 2025HitoMi-Cam: A Shape-Agnostic Person Detection Method Using the Spectral Characteristics of Clothingcited by 0
- 2026Towards automatic smoke detector inspection: Recognition of the smoke detectors in industrial facilities and preparation for future drone integrationcited by 0
- 2026Is INT8 Portable? A Cross-Platform Measurement Study of Quantized Inference on Embedded and Automotive Acceleratorscited by 0
- 2026Is INT8 Portable? A Cross-Platform Measurement Study of Quantized Inference on Embedded and Automotive Accelerators14 Sep 2026
- 2026Towards automatic smoke detector inspection: Recognition of the smoke detectors in industrial facilities and preparation for future drone integration25 Mar 2026
- 2025Development and Testing for Perception Based Autonomous Landing of a Long-Range QuadPlane10 Dec 2025
- 2025HitoMi-Cam: A Shape-Agnostic Person Detection Method Using the Spectral Characteristics of Clothing12 Nov 2025
- 2025A Comprehensive Evaluation of YOLO-based Deer Detection Performance on Edge Devices24 Sep 2025
- 2025Designing Object Detection Models for TinyML: Foundations, Comparative Analysis, Challenges, and Emerging Solutions11 Aug 2025