Rethinking Streaming-Perception Evaluation on Heterogeneous Edge Platforms
Not on the map. Why?
Abstract (arXiv)
Multi-camera streaming perception is increasingly deployed on heterogeneous edge platforms shared with co-resident workloads, yet accelerator placement is often evaluated using isolated single-stream experiments and mean streaming average precision (sAP). Using two end-to-end pipelines on a single GPU--NPU platform, we show that isolated evaluation can mis-rank deployment-time placement. Although the GPU pipeline is preferred in isolation, GPU-localized contention introduces deadline misses that make detections stale and can reverse the preferred placement before full GPU saturation. The NPU pipeline is less accurate than the GPU pipeline on small and medium objects in isolation, but nearly matches it on large objects. The largest absolute sAP losses in our latency and contention experiments occur for large objects. In our four-stream experiments, the preferred placement depends on which path becomes stale, and increasing GPU-side contention shifts the best placement from All-GPU to All-NPU. Under a GPU-saturating vision--language co-tenant, All-NPU achieves 5.2× the worst-stream sAP of All-GPU. Because mean sAP can hide severe single-stream degradation, evaluation should report contention sweeps, deadline-miss rates on both paths, and worst-stream sAP alongside mean sAP.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 4 Oct 2026.
Builds on
19 of 29 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2024TinyLlama: An Open-Source Small Language Modelcited by 618
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 515
- 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 305
- 2017Device Placement Optimization with Reinforcement Learningcited by 86
- 2022Real-time Object Detection for Streaming Perceptioncited by 30
- 2022Are We Ready for Vision-Centric Driving Streaming Perception? The ASAP Benchmarkcited by 26
- 2022iGniter: Interference-Aware GPU Resource Provisioning for Predictable DNN Inference in the Cloudcited by 14
7 more
- 2023DAMO-StreamNet: Optimizing Streaming Perception in Autonomous Drivingcited by 13
- 2022LongShortNet: Exploring Temporal and Semantic Features Fusion in Streaming Perceptioncited by 12
- 2022StreamYOLO: Real-time Object Detection for Streaming Perceptioncited by 7
- 2021TOD: Transprecise Object Detection to Maximise Real-Time Accuracy on the Edgecited by 4
- 2024Transtreaming: Adaptive Delay-aware Transformer for Real-time Streaming Perceptioncited by 3
- 2025Towards Latency-Aware 3D Streaming Perception for Autonomous Drivingcited by 2
- 2023BiSwift: Bandwidth Orchestrator for Multi-Stream Video Analytics on Edgecited by 1
Built on by
Not cited yet.