mlsanityData to 14 Oct 2026

Moving Like a Human: Ego-Motion-Normalized Temporal Signatures for Real-Time Aerial Person Tracking on Milliwatt-Class Hardware

arXiv 2607.16282 ↗First posted 9 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Follow-me person tracking must run on the drone itself, where affordable companion computers offer only a few effective int8 GFLOP/s. At typical follow distances a person spans 10-60 pixels, indistinguishable from clutter and beyond the reach of single-frame appearance detectors. The missing evidence is temporal and belongs in the input representation, computed analytically, rather than in learned temporal machinery. EMTS-Det is a five-stage system that estimates ego-motion, converts each frame into ego-motion-normalized residual-motion channels, detects person centers with a 22k-parameter, 7.6-MFLOP network, tracks a locked target with a Kalman filter in stabilized coordinates, and verifies tracks with a 1-D convolutional classifier of human motion (ROC AUC 0.941). Training uses a synthetic-motion curriculum with motion channels generated by the deployed ego-motion code. Multi-seed ablations locate the value in generalization: on held-out VisDrone-DET a luminance-only variant collapses to 0.051 AP25 versus 0.415, as does YOLOv8n fine-tuned identically despite 1,100 times the compute, while the deployed int8 detector reaches 0.694 AP25 in-domain and 0.444 on this split. Temporal-shift modules lower accuracy, so the deployed detector is stateless. Silent int8 calibration failures are documented; min-max calibration with propagated caches matches float within 0.008 AP. On a Raspberry Pi Zero 2W the pipeline runs at 31.85 FPS with 0.462 AP25 and 0.714 recall over 1,000 real-world UAV videos, versus 1.95 FPS and 0.172 AP25 for YOLOv8n. A 57-second field sequence shows auto-lock at 1.3 s, 97.9% lock recall, and recovery from all nine occlusions with zero false re-locks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 39 references that are in the map. First posted on arXiv 9 Jul 2026.

Builds on

25 of 39 references.

References · 25

  1. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  2. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  3. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  4. 2015SSD: Single Shot MultiBox Detectorcited by 3,130
  5. 2020Supervised Contrastive Learningcited by 2,829
  6. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
  7. 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
  8. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  9. 2019Objects as Pointscited by 1,175
  10. 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
  11. 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 902
  12. 2016Simple Online and Realtime Trackingcited by 868
13 more
  1. 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
  2. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
  3. 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
  4. 2019Learned Step Size Quantizationcited by 628
  5. 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
  6. 2018Quantizing deep convolutional networks for efficient inference: A whitepapercited by 521
  7. 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 490
  8. 2021A White Paper on Neural Network Quantizationcited by 472
  9. 2017Learning from Synthetic Humanscited by 359
  10. 2020Detection and Tracking Meet Drones Challengecited by 263
  11. 2021MoViNets: Mobile Video Networks for Efficient Video Recognitioncited by 135
  12. 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 122
  13. 2021PP-PicoDet: A Better Real-Time Object Detector on Mobile Devicescited by 25

Built on by

Not cited yet.