KOALA: Koopman Operator Learning for WiFi-Based Anticipatory Hum
Not on the map. Why?
Abstract (arXiv)
WiFi Channel State Information (CSI) has emerged as a privacy-preserving alternative to cameras for human pose estimation. However, existing approaches treat pose inference as an instantaneous regression problem and do not model temporal dynamics, making future motion prediction infeasible. Naively applying vision-based prediction methods compounds the estimation noise already present in CSI-derived poses, as autoregressive rollouts amplify errors at every step. We propose KOALA, the framework for human motion prediction directly from WiFi CSI, by lifting noisy CSI-derived pose sequences into a learned Koopman latent space where nonlinear dynamics become linear, enabling multi-horizon prediction via simple matrix-vector products without autoregressive iteration or error accumulation. A residual CSI-conditioned operator resolves the identity attractor problem inherent from Koopman formulations, and an anchor-delta prediction head eliminates the degenerate shortcut of copying the current pose across all horizons. To regularise the lifting and operator jointly, we introduce a Koopman Anchored Latent (KAL) loss that operates in the temporal-encoder feature space, enforcing dynamical consistency across prediction horizons without requiring contrastive, spectral, or auxiliary losses. Experiments on MM-Fi and WiPose show that KOALA achieves robust, consistent performance across both short- and long-term prediction horizons, outperforming all baselines by a substantial margin.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 35 references that are in the map. First posted on arXiv 16 Aug 2026.
Builds on
24 of 35 references.
References · 24
- 2017Attention Is All You Needcited by 60,361
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
- 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 408
- 2017On human motion prediction using recurrent neural networkscited by 338
- 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 246
- 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
- 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 165
- 2021MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Predictioncited by 100
- 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 100
- 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 92
12 more
- 2023MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensingcited by 79
- 2021Multiscale Spatio-Temporal Graph Neural Networks for 3D Skeleton-Based Motion Predictioncited by 37
- 2024VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecastingcited by 35
- 2022SenseFi: A Library and Benchmark on Deep-Learning-Empowered WiFi Human Sensingcited by 34
- 2023SwinLSTM:Improving Spatiotemporal Prediction Accuracy using Swin Transformer and LSTMcited by 32
- 20223D Human Motion Prediction: A Surveycited by 30
- 2022MetaFi: Device-Free Pose Estimation via Commodity WiFi for Metaverse Avatar Simulationcited by 22
- 2023Auxiliary Tasks Benefit 3D Skeleton-based Human Motion Predictioncited by 20
- 2024WiMANS: A Benchmark Dataset for WiFi-based Multi-user Activity Sensingcited by 18
- 2023AdaPose: Towards Cross-Site Device-Free Human Pose Estimation with Commodity WiFicited by 12
- 2023Robust data-driven control for nonlinear systems using the Koopman operatorcited by 6
- 2025Graph-based 3D Human Pose Estimation using WiFi Signalscited by 4
Built on by
Not cited yet.