IMU-Bench: Benchmarking Wrist IMU Representations Across Kinematic, Semantic and Clinical Tasks
Not on the map. Why?
Abstract (arXiv)
Wrist-worn inertial measurement units (IMUs) provide a common sensing modality for tasks ranging from activity and gesture recognition to pose estimation, inertial odometry and clinical motor assessment. Existing wearable benchmarks evaluate performance across multiple tasks, but leave open how supervision for one task affects transfer to others and whether these tasks benefit from a shared representation. We present IMU-Bench, a benchmark of ten tasks from eight datasets for studying IMU multi-task performance and cross-task transfer. We compare six self-supervised methods pretrained on unlabeled recorded and simulated wrist motion, evaluating classification, pose and velocity estimation, and IMU-language retrieval. We find that our masked autoencoder, InrtlWrist, achieves the best or joint-best frozen-probe performance on nine of ten tasks, and fine-tuning improves on training from scratch on nine of ten tasks, including full-body pose, odometry and retrieval. Across transfer and joint-training experiments, supervision that benefits one target can reduce performance on others, with supervised sources transferring within kinematic estimation while, under frozen probing, none approaches the pretrained encoder on language retrieval, and joint-training gains that come at a cost to the paired task. These findings distinguish broad downstream usefulness from complementary task supervision. Code, task cards and a leaderboard are publicly available.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 84 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
48 of 84 references.
References · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2019Designing and Interpreting Probes with Control Taskscited by 640
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
- 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 528
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
- 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 375
36 more
- 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 229
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
- 2019Task2Vec: Task Embedding for Meta-Learningcited by 205
- 2022Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensorscited by 146
- 2017Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring using Convolutional Neural Networkscited by 131
- 2020Exploring and Predicting Transferability across NLP Taskscited by 128
- 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 114
- 2019Multi-task Self-Supervised Learning for Human Activity Detectioncited by 102
- 2023Large-scale Training of Foundation Models for Wearable Biosignalscited by 95
- 2022Transformer Inertial Poser: Real-time Human Motion Reconstruction from Sparse IMUs with Simultaneous Terrain Generationcited by 76
- 2022Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Datacited by 75
- 2019RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, and New Methodscited by 73
- 2022Assessing the State of Self-Supervised Human Activity Recognition using Wearablescited by 65
- 2024Scaling Wearable Foundation Modelscited by 63
- 2018IONet: Learning to Cure the Curse of Drift in Inertial Odometrycited by 55
- 2020TLIO: Tight Learned Inertial Odometrycited by 55
- 2023IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbudscited by 54
- 2025SensorLM: Learning the Language of Wearable Sensorscited by 49
- 2023FOCAL: Contrastive Learning for Multimodal Time-Series Sensing Signals in Factorized Orthogonal Latent Spacecited by 33
- 2025Motion-X++: A Large-Scale Multimodal 3D Whole-body Human Motion Datasetcited by 33
- 2024Toward Foundation Model for Multivariate Wearable Sensing of Physiological Signalscited by 32
- 2024UniMTS: Unified Pre-training for Motion Time Seriescited by 26
- 2025MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devicescited by 23
- 2024IMUGPT 2.0: Language-Based Cross Modality Transfer for Sensor-Based Human Activity Recognitioncited by 22
- 2024RelCon: Relative Contrastive Learning for a Motion Foundation Model for Wearable Datacited by 20
- 2024PRIMUS: Pretraining IMU Encoders with Multimodal Self-Supervisioncited by 10
- 2025AirIO: Learning Inertial Odometry with Enhanced IMU Feature Observabilitycited by 7
- 2022Eat-Radar: Continuous Fine-Grained Intake Gesture Detection Using FMCW Radar and 3D Temporal Convolutional Network with Attentioncited by 5
- 2023Eating Speed Measurement Using Wrist-Worn IMU Sensors Towards Free-Living Environmentscited by 3
- 2026Inertia-1: An Open Exploration of Wearable Motion Foundation Modelscited by 3
- 2025SlotFM: A Motion Foundation Model with Slot Attention for Diverse Downstream Taskscited by 2
- 2026Bio-Inspired Self-Supervised Learning for Wrist-worn Accelerometer Datacited by 2
- 2026OpenWatch: A Multimodal Benchmark for Hand Gesture Recognition on Smartwatchescited by 2
- 2026BenchHAR: Benchmarking Self-Supervised Learning for Generalizable Sensor-based Activity Recognitioncited by 2
- 2026Physical Self-Supervised Learning: IMU Sensing without Manual Labelscited by 2
- 2026TransfHAR: Self-Supervised Wrist Representations for On-Demand Activity Recognitioncited by 1
Built on by
Not cited yet.