mlsanityData to 14 Oct 2026

KOALA: Koopman Operator Learning for WiFi-Based Anticipatory Hum

arXiv 2608.15815 ↗First posted 16 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

WiFi Channel State Information (CSI) has emerged as a privacy-preserving alternative to cameras for human pose estimation. However, existing approaches treat pose inference as an instantaneous regression problem and do not model temporal dynamics, making future motion prediction infeasible. Naively applying vision-based prediction methods compounds the estimation noise already present in CSI-derived poses, as autoregressive rollouts amplify errors at every step. We propose KOALA, the framework for human motion prediction directly from WiFi CSI, by lifting noisy CSI-derived pose sequences into a learned Koopman latent space where nonlinear dynamics become linear, enabling multi-horizon prediction via simple matrix-vector products without autoregressive iteration or error accumulation. A residual CSI-conditioned operator resolves the identity attractor problem inherent from Koopman formulations, and an anchor-delta prediction head eliminates the degenerate shortcut of copying the current pose across all horizons. To regularise the lifting and operator jointly, we introduce a Koopman Anchored Latent (KAL) loss that operates in the temporal-encoder feature space, enforcing dynamical consistency across prediction horizons without requiring contrastive, spectral, or auxiliary losses. Experiments on MM-Fi and WiPose show that KOALA achieves robust, consistent performance across both short- and long-term prediction horizons, outperforming all baselines by a substantial margin.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 35 references that are in the map. First posted on arXiv 16 Aug 2026.

Builds on

24 of 35 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  4. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
  5. 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 408
  6. 2017On human motion prediction using recurrent neural networkscited by 338
  7. 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 246
  8. 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
  9. 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 165
  10. 2021MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Predictioncited by 100
  11. 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 100
  12. 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 92
12 more
  1. 2023MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensingcited by 79
  2. 2021Multiscale Spatio-Temporal Graph Neural Networks for 3D Skeleton-Based Motion Predictioncited by 37
  3. 2024VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecastingcited by 35
  4. 2022SenseFi: A Library and Benchmark on Deep-Learning-Empowered WiFi Human Sensingcited by 34
  5. 2023SwinLSTM:Improving Spatiotemporal Prediction Accuracy using Swin Transformer and LSTMcited by 32
  6. 20223D Human Motion Prediction: A Surveycited by 30
  7. 2022MetaFi: Device-Free Pose Estimation via Commodity WiFi for Metaverse Avatar Simulationcited by 22
  8. 2023Auxiliary Tasks Benefit 3D Skeleton-based Human Motion Predictioncited by 20
  9. 2024WiMANS: A Benchmark Dataset for WiFi-based Multi-user Activity Sensingcited by 18
  10. 2023AdaPose: Towards Cross-Site Device-Free Human Pose Estimation with Commodity WiFicited by 12
  11. 2023Robust data-driven control for nonlinear systems using the Koopman operatorcited by 6
  12. 2025Graph-based 3D Human Pose Estimation using WiFi Signalscited by 4

Built on by

Not cited yet.