Moving Like a Human: Ego-Motion-Normalized Temporal Signatures for Real-Time Aerial Person Tracking on Milliwatt-Class Hardware
Not on the map. Why?
Abstract (arXiv)
Follow-me person tracking must run on the drone itself, where affordable companion computers offer only a few effective int8 GFLOP/s. At typical follow distances a person spans 10-60 pixels, indistinguishable from clutter and beyond the reach of single-frame appearance detectors. The missing evidence is temporal and belongs in the input representation, computed analytically, rather than in learned temporal machinery. EMTS-Det is a five-stage system that estimates ego-motion, converts each frame into ego-motion-normalized residual-motion channels, detects person centers with a 22k-parameter, 7.6-MFLOP network, tracks a locked target with a Kalman filter in stabilized coordinates, and verifies tracks with a 1-D convolutional classifier of human motion (ROC AUC 0.941). Training uses a synthetic-motion curriculum with motion channels generated by the deployed ego-motion code. Multi-seed ablations locate the value in generalization: on held-out VisDrone-DET a luminance-only variant collapses to 0.051 AP25 versus 0.415, as does YOLOv8n fine-tuned identically despite 1,100 times the compute, while the deployed int8 detector reaches 0.694 AP25 in-domain and 0.444 on this split. Temporal-shift modules lower accuracy, so the deployed detector is stateless. Silent int8 calibration failures are documented; min-max calibration with propagated caches matches float within 0.008 AP. On a Raspberry Pi Zero 2W the pipeline runs at 31.85 FPS with 0.462 AP25 and 0.714 recall over 1,000 real-world UAV videos, versus 1.95 FPS and 0.172 AP25 for YOLOv8n. A 57-second field sequence shows auto-lock at 1.3 s, 97.9% lock recall, and recovery from all nine occlusions with zero false re-locks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 39 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
25 of 39 references.
References · 25
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2020Supervised Contrastive Learningcited by 2,829
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2019Objects as Pointscited by 1,175
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
- 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 902
- 2016Simple Online and Realtime Trackingcited by 868
13 more
- 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2019Learned Step Size Quantizationcited by 628
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
- 2018Quantizing deep convolutional networks for efficient inference: A whitepapercited by 521
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 490
- 2021A White Paper on Neural Network Quantizationcited by 472
- 2017Learning from Synthetic Humanscited by 359
- 2020Detection and Tracking Meet Drones Challengecited by 263
- 2021MoViNets: Mobile Video Networks for Efficient Video Recognitioncited by 135
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 122
- 2021PP-PicoDet: A Better Real-Time Object Detector on Mobile Devicescited by 25
Built on by
Not cited yet.