mlsanityData to 7 Oct 2026

AIGaitor: Privacy-preserving and cloud-free motion analysis for everyone, using edge computing

arXiv 2605.21421 ↗First posted 20 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Motion capture is the gold standard for measuring human movement, but clinical use remains limited by cost, technical complexity, and privacy concerns. AIGaitor is a privacy-preserving, cloud-free motion analysis system that runs markerless monocular motion-capture pipelines and downstream deep-learning analysis entirely on a consumer smartphone using on-device neural accelerators. To motivate its design, we surveyed 74 rehabilitation clinicians: 92 percent said they would adopt an accurate, cost-effective, easy-to-use AI gait analysis tool, while 79.7 percent cited operating cost, 68.9 percent insufficient training, and 64.9 percent privacy concerns as leading barriers. We then optimized and benchmarked mobile iOS implementations of current monocular pipeline components, including 2D and 3D pose estimation, pose optimization, skeleton-based deep-learning analysis, and a vision-language model. A Time-Priority end-to-end on-device pipeline processes a 10 s 4K 60 fps video clip in 77 s on an iPhone 14, matching or beating the same pipeline on a high-end NVIDIA H200 cloud server when network transfer is included: 94 s at global mobile-average uplink and 66 s at developed-world Wi-Fi. Lightweight models such as ViTPose-s achieve real-time keypoint extraction, and skeleton-based action-recognition models provide sub-millisecond gait classification on the same clip. To our knowledge, AIGaitor is the first monocular system to demonstrate end-to-end on-device motion capture and downstream deep-learning analysis, supporting clinically applicable movement analysis that is low-cost, private, and accessible to smartphone users.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 91 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

32 of 91 references.

References · 32

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  4. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
  5. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  6. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
  7. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  8. 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,234
  9. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  10. 2022Token Merging: Your ViT But Fastercited by 995
  11. 2017End-to-end Recovery of Human Shape and Posecited by 883
  12. 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
20 more
  1. 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 401
  2. 2024ShortGPT: Layers in Large Language Models are More Redundant Than You Expectcited by 369
  3. 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
  4. 2024The Unreasonable Ineffectiveness of the Deeper Layerscited by 219
  5. 2018Markerless tracking of user-defined features with deep learningcited by 203
  6. 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
  7. 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
  8. 2020TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systemscited by 161
  9. 2020BlazePose: On-device Real-time Body Pose trackingcited by 112
  10. 2024CameraHMR: Aligning People with Perspectivecited by 64
  11. 2022Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formatscited by 50
  12. 2020MeTRAbs: Metric-Scale Truncation-Robust Heatmaps for Absolute 3D Human Pose Estimationcited by 35
  13. 2025MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devicescited by 20
  14. 2025BioPose: Biomechanically-accurate 3D Pose Estimation from Monocular Videoscited by 16
  15. 2022BlazePose GHUM Holistic: Real-time 3D Human Landmarks and Pose Estimationcited by 13
  16. 2025Portable Biomechanics Laboratory: Clinically Accessible Movement Analysis from a Handheld Smartphonecited by 8
  17. 2026OpenCap Monocular: 3D Human Kinematics and Musculoskeletal Dynamics from a Single Smartphone Videocited by 7
  18. 2025FastHMR: Accelerating Human Mesh Recovery via Token and Layer Merging with Diffusion Decodingcited by 4
  19. 2022Incidental Data: Observation of Privacy Compromising Data on Social Media Platformscited by 1
  20. 2024Classifying Simulated Gait Impairments using Privacy-preserving Explainable Artificial Intelligence and Mobile Phone Videoscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026OGA-AID: Clinician-in-the-loop AI Report Drafting Assistant for Multimodal Observational Gait Analysis in Post-Stroke Rehabilitation
  2. 2026A-Live: Passive Liveness Detection via Neuromuscular Micro-Motion Signatures on Commodity Sensors ↗
  3. 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark
  4. 2023DiffusionPoser: Real-time Human Motion Reconstruction From Arbitrary Sparse Sensors Using Autoregressive Diffusion
  5. 2025Towards Human-AI-Robot Collaboration and AI-Agent based Digital Twins for Parkinson's Disease Management: Review and Outlook ↗
  6. 2024FastUMI: A Scalable and Hardware-Independent Universal Manipulation Interface with Dataset
  7. 2026BiomechAgent: AI-Assisted Biomechanical Analysis Through Code-Generating Agents
  8. 2026Agentic Pipeline for Self-Synchronized Multiview Joint Angle Monitoring in Uncalibrated Environments