# Sensor-Specific Transformer (PatchTST) Ensembles with Test-Matched Augmentation

arXiv: https://arxiv.org/abs/2510.21282 · HTML: https://mlsanity.com/paper/2510.21282/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 5 of its 17 references that are in the map.
- First posted on arXiv 24 Oct 2025.

## Builds on (most cited first, 5 of 5)

- [Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting](https://mlsanity.com/paper/2012.07436/) (2020)
- [A Time Series is Worth 64 Words: Long-term Forecasting with Transformers](https://mlsanity.com/paper/2211.14730/) (2022)
- [Cross-Subject Transfer Learning in Human Activity Recognition Systems using Generative Adversarial Networks](https://mlsanity.com/paper/1903.12489/) (2019)
- [Attend And Discriminate: Beyond the State-of-the-Art for Human Activity Recognition using Wearable Sensors](https://mlsanity.com/paper/2007.07172/) (2020)
- [Smartphone Sensor-based Human Activity Recognition Robust to Different Sampling Rates](https://mlsanity.com/paper/2101.00812/) (2021)

## Abstract (arXiv)

We present a noise-aware, sensor-specific ensemble approach for robust human activity recognition on the 2nd WEAR Dataset Challenge. Our method leverages the PatchTST transformer architecture, training four independent models-one per inertial sensor location-on a tampered training set whose 1-second sliding windows are augmented to mimic the test-time noise. By aligning the train and test data schemas (JSON-encoded 50-sample windows) and applying randomized jitter, scaling, rotation, and channel dropout, each PatchTST model learns to generalize across real-world sensor perturbations. At inference, we compute softmax probabilities from all four sensor models on the Kaggle test set and average them to produce final labels. On the private leaderboard, this pipeline achieves a macro-F1 substantially above the baseline, demonstrating that test-matched augmentation combined with transformer-based ensembling is an effective strategy for robust HAR under noisy conditions.