RAMS: Resource-Adaptive and Detection-Conditioned Model Switching for Embedded Edge Perception
Not on the map. Why?
Abstract (arXiv)
Edge object detection on embedded hardware requires balancing inference latency and detection quality under changing resource pressure. We present RAMS, a lightweight runtime controller that monitors device pressure, calibrates switching thresholds from idle behavior, and dynamically selects among three resident YOLOv8 tiers (NANO/SMALL/MEDIUM at 320/416/640 px) without model-reload latency. RAMS defines five switching policies, including two detection-conditioned variants that prevent aggressive downgrades after recent vulnerable-road-user (VRU) detections. We further introduce the VRU-Weighted Accuracy Score (SWAS), a scalar metric for offline policy comparison without ground-truth annotations, together with an oracle-bounded variant that separates detector circularity from genuine tier-retention benefit. Across Raspberry Pi 5, x86 laptops, and Jetson Orin ONNX/TensorRT deployments, the same controller equations operate over a 37x latency range. On Jetson Orin TensorRT under heavy load, the safety2 policy achieves 3.41 ms mean latency, 5.6x faster than fixed-MEDIUM inference, while retaining 74% of its proxy accuracy through near-NANO operation with selective SMALL and MEDIUM locks during VRU-positive windows. Detection-conditioned switching improves SWAS by 25.4% under oracle scoring and 47.3% under detector-derived scoring relative to threshold-only policies under heavy load. Live KITTI evaluation reports per-tier VRU recall of 24.2%, 41.2%, and 59.0%, showing that reactive overrides are fundamentally limited by baseline detector recall.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
17 of 33 references.
References · 17
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 778
- 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 591
- 2016Clipper: A Low-Latency Online Prediction Serving Systemcited by 191
- 2017Adaptive Neural Networks for Efficient Inferencecited by 161
- 2021Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Bettercited by 153
5 more
- 2019Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computingcited by 150
- 2019Towards Efficient Model Compression via Learned Global Rankingcited by 75
- 2018Autonomous Vehicles that Interact with Pedestrians: A Survey of Theory and Practicecited by 74
- 2018NestDNN: Resource-Aware Multi-Tenant On-Device Deep Learning for Continuous Mobile Visioncited by 68
- 2024System-Level Safety Monitoring and Recovery for Perception Failures in Autonomous Vehiclescited by 5
Built on by
Not cited yet.