mlsanityData to 7 Oct 2026

Phase-driven Domain Generalizable Learning for Nonstationary Time Series

arXiv 2402.05960 ↗First posted 5 Feb 2024cs.LG eess.SPcited by 4

Not on the map. Why?

Abstract (arXiv)

Pattern recognition is a fundamental task in continuous sensing applications, but real-world scenarios often experience distribution shifts that necessitate learning generalizable representations for such tasks. This challenge is exacerbated with time-series data, which also exhibit inherent nonstationarity--variations in statistical and spectral properties over time. In this work, we offer a fresh perspective on learning generalizable representations for time-series classification by considering the phase information of a signal as an approximate proxy for nonstationarity and propose a phase-driven generalizable representation learning framework for time-series classification, PhASER. It consists of three key elements: 1) Hilbert transform-based augmentation, which diversifies nonstationarity while preserving task-specific discriminatory semantics, 2) separate magnitude-phase encoding, viewing time-varying magnitude and phase as independent modalities, and 3) phase-residual feature broadcasting, integrating 2D phase features with a residual connection to the 1D signal representation, providing inherent regularization to improve distribution-invariant learning. Extensive evaluations on five datasets from sleep-stage classification, human activity recognition, and gesture recognition against 13 state-of-the-art baseline methods demonstrate that PhASER consistently outperforms the best baselines by an average of 5% and up to 11% in some cases. Additionally, the principles of PhASER can be broadly applied to enhance the generalizability of existing time-series representation learning models.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 65 of its 114 references that are in the map. First posted on arXiv 5 Feb 2024.

Builds on

65 of 114 references.

References · 65

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  4. 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
  5. 2020In Search of Lost Domain Generalizationcited by 1,042
  6. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  7. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
  8. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
  9. 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 682
  10. 2018Deep learning for time series classification: a reviewcited by 575
  11. 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
  12. 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
38 more
  1. 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 386
  2. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
  3. 2021A Fourier-based Framework for Domain Generalizationcited by 287
  4. 2018A Survey on Deep Learning for Named Entity Recognitioncited by 281
  5. 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 246
  6. 2020Time Series Data Augmentation for Deep Learning: A Surveycited by 225
  7. 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
  8. 2019Time2Vec: Learning a Vector Representation of Timecited by 208
  9. 2021Learning to Diversify for Single Domain Generalizationcited by 170
  10. 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 143
  11. 2020Learning explanations that are hard to varycited by 132
  12. 2017Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring using Convolutional Neural Networkscited by 130
  13. 2020An Empirical Survey of Data Augmentation for Time Series Classification with Neural Networkscited by 128
  14. 2021AdaRNN: Adaptive Learning and Forecasting of Time Seriescited by 120
  15. 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 110
  16. 2023Bake off redux: a review and experimental evaluation of recent time series classification algorithmscited by 99
  17. 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 98
  18. 2022Unsupervised Time-Series Representation Learning with Iterative Bilinear Temporal-Spectral Fusioncited by 96
  19. 2020Multi-Source Deep Domain Adaptation with Weak Supervision for Time-Series Sensor Datacited by 82
  20. 2015Spectral Representations for Convolutional Neural Networkscited by 79
  21. 2018Multilevel Wavelet Decomposition Network for Interpretable Time Series Analysiscited by 61
  22. 2023Domain Adaptation for Time Series Under Feature and Label Shiftscited by 60
  23. 2017Regularizing Deep Neural Networks by Noise: Its Interpretation and Optimizationcited by 56
  24. 2023A Survey on Time-Series Pre-Trained Modelscited by 52
  25. 2022TFAD: A Decomposition Time Series Anomaly Detection Architecture with Time-Frequency Analysiscited by 48
  26. 2019Bayesian Temporal Factorization for Multidimensional Time Series Predictioncited by 47
  27. 2021Broadcasted Residual Learning for Efficient Keyword Spottingcited by 47
  28. 2022ADATIME: A Benchmarking Suite for Domain Adaptation on Time Series Datacited by 45
  29. 2023A Survey on Deep Learning based Time Series Analysis with Frequency Transformationcited by 40
  30. 2019Why ResNet Works? Residuals Generalizecited by 39
  31. 2022What Makes Good Contrastive Learning on Small-Scale Wearable-based Tasks?cited by 39
  32. 2022Self-supervised Contrastive Representation Learning for Semi-supervised Time-Series Classificationcited by 39
  33. 2022Domain-invariant Feature Exploration for Domain Generalizationcited by 34
  34. 2022Temporal Domain Generalization with Drift-Aware Dynamic Neural Networkscited by 32
  35. 2022Out-of-Distribution Representation Learning for Time Series Classificationcited by 30
  36. 2015A New PAC-Bayesian Perspective on Domain Adaptationcited by 29
  37. 2022WOODS: Benchmarks for Out-of-Distribution Generalization in Time Seriescited by 29
  38. 2022GLOBEM Dataset: Multi-Year Datasets for Longitudinal Human Behavior Modeling Generalizationcited by 28

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.