mlsanityData to 7 Oct 2026

Collaborative Temporal Feature Generation via Critic-Free Reinforcement Learning for Cross-User Sensor-Based Activity Recognition

arXiv 2603.16043 ↗First posted 17 Mar 2026cs.LG cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Human Activity Recognition using wearable inertial sensors is foundational to healthcare monitoring, fitness analytics, and context-aware computing, yet its deployment is hindered by cross-user variability arising from heterogeneous physiological traits, motor habits, and sensor placements. Existing domain generalization approaches either neglect temporal dependencies in sensor streams or depend on impractical target-domain annotations. We propose a different paradigm: modeling generalizable feature extraction as a collaborative sequential generation process governed by reinforcement learning. Our framework, CTFG (Collaborative Temporal Feature Generation), employs a Transformer-based autoregressive generator that incrementally constructs feature token sequences, each conditioned on prior context and the encoded sensor input. The generator is optimized via Group-Relative Policy Optimization, a critic-free algorithm that evaluates each generated sequence against a cohort of alternatives sampled from the same input, deriving advantages through intra-group normalization rather than learned value estimation. This design eliminates the distribution-dependent bias inherent in critic-based methods and provides self-calibrating optimization signals that remain stable across heterogeneous user distributions. A tri-objective reward comprising class discrimination, cross-user invariance, and temporal fidelity jointly shapes the feature space to separate activities, align user distributions, and preserve fine-grained temporal content. Evaluations on the DSADS and PAMAP2 benchmarks demonstrate state-of-the-art cross-user accuracy (88.53% and 75.22%), substantial reduction in inter-task training variance, accelerated convergence, and robust generalization under varying action-space dimensionalities.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 51 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

24 of 51 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  5. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  6. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  7. 2021Domain Generalization: A Surveycited by 760
  8. 2022Transformers in Time Series: A Surveycited by 489
  9. 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
  10. 2020Learning explanations that are hard to varycited by 132
  11. 2021AdaRNN: Adaptive Learning and Forecasting of Time Seriescited by 120
  12. 2023Improving Position Encoding of Transformers for Multivariate Time Series Classificationcited by 44
12 more
  1. 2023DIVERSIFY: A General Framework for Time Series Out-of-distribution Detection and Generalizationcited by 24
  2. 2024UniMTS: Unified Pre-training for Motion Time Seriescited by 22
  3. 2022SWL-Adapt: An Unsupervised Domain Adaptation Model with Sample Weight Learning for Cross-User Wearable Human Activity Recognitioncited by 21
  4. 2024IMUGPT 2.0: Language-Based Cross Modality Transfer for Sensor-Based Human Activity Recognitioncited by 20
  5. 2022Domain Generalization for Activity Recognition via Adaptive Feature Fusioncited by 16
  6. 2023Optimization-Free Test-Time Adaptation for Cross-Person Activity Recognitioncited by 15
  7. 2022Transformer-based Models to Deal with Heterogeneous Environments in Human Activity Recognitioncited by 12
  8. 2023Generalizable Low-Resource Activity Recognition with Diverse and Discriminative Representation Learningcited by 12
  9. 2022TASKED: Transformer-based Adversarial learning for human activity recognition using wearable sensors via Self-KnowledgE Distillationcited by 10
  10. 2024Diverse Intra- and Inter-Domain Activity Style Fusion for Cross-Person Generalization in Activity Recognitioncited by 6
  11. 2024Generalizable Sensor-Based Activity Recognition via Categorical Concept Invariant Learningcited by 5
  12. 2025Deconfounding Causal Inference through Two-Branch Framework with Early-Forking for Sensor-Based Cross-Domain Activity Recognitioncited by 2

Built on by

Not cited yet.