mlsanityData to 14 Oct 2026

POND: Multi-Source Time Series Domain Adaptation with Information-Aware Prompt Tuning

arXiv 2312.12276 ↗First posted 19 Dec 2023cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Time series domain adaptation stands as a pivotal and intricate challenge with diverse applications, including but not limited to human activity recognition, sleep stage classification, and machine fault diagnosis. Despite the numerous domain adaptation techniques proposed to tackle this complex problem, they primarily focus on domain adaptation from a single source domain. Yet, it is more crucial to investigate domain adaptation from multiple domains due to the potential for greater improvements. To address this, three important challenges need to be overcome: 1). The lack of exploration to utilize domain-specific information for domain adaptation, 2). The difficulty to learn domain-specific information that changes over time, and 3). The difficulty to evaluate learned domain-specific information. In order to tackle these challenges simultaneously, in this paper, we introduce PrOmpt-based domaiN Discrimination (POND), the first framework to utilize prompts for time series domain adaptation. Specifically, to address Challenge 1, we extend the idea of prompt tuning to time series analysis and learn prompts to capture common and domain-specific information from all source domains. To handle Challenge 2, we introduce a conditional module for each source domain to generate prompts from time series input data. For Challenge 3, we propose two criteria to select good prompts, which are used to choose the most suitable source domain for domain adaptation. The efficacy and robustness of our proposed POND model are extensively validated through experiments across 50 scenarios encompassing four datasets. Experimental results demonstrate that our proposed POND model outperforms all state-of-the-art comparison methods by up to 66% on the F1-score.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 38 of its 55 references that are in the map. First posted on arXiv 19 Dec 2023.

Builds on

38 of 55 references.

References · 38

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  3. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  4. 2023A Survey of Large Language Modelscited by 2,576
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  7. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
  8. 2018On First-Order Meta-Learning Algorithmscited by 1,018
  9. 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 737
  10. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  11. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  12. 2019On Variational Bounds of Mutual Informationcited by 559
26 more
  1. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
  2. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 471
  3. 2020CLUB: A Contrastive Log-ratio Upper Bound of Mutual Informationcited by 235
  4. 2018A DIRT-T Approach to Unsupervised Domain Adaptationcited by 215
  5. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
  6. 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 172
  7. 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 169
  8. 2023Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Surveycited by 135
  9. 2021Deep Subdomain Adaptation Network for Image Classificationcited by 119
  10. 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 110
  11. 2019Domain Agnostic Learning with Disentangled Representationscited by 108
  12. 2022Unsupervised Time-Series Representation Learning with Iterative Bilinear Temporal-Spectral Fusioncited by 96
  13. 2020Multi-Source Deep Domain Adaptation with Weak Supervision for Time-Series Sensor Datacited by 82
  14. 2021Domain Adaptation for Time Series Forecasting via Attention Sharingcited by 68
  15. 2023Domain Adaptation for Time Series Under Feature and Label Shiftscited by 60
  16. 2023Time Series Contrastive Learning with Information-Aware Augmentationscited by 52
  17. 2020Time Series Domain Adaptation via Sparse Associative Structure Alignmentcited by 51
  18. 2020Multi-source Domain Adaptation in the Deep Learning Era: A Systematic Surveycited by 47
  19. 2022ADATIME: A Benchmarking Suite for Domain Adaptation on Time Series Datacited by 45
  20. 2022IDPG: An Instance-Dependent Prompt Generation Methodcited by 43
  21. 2019On Minimum Discrepancy Estimation for Deep Domain Adaptationcited by 34
  22. 2022Temporal Domain Generalization with Drift-Aware Dynamic Neural Networkscited by 33
  23. 2023Universality and Limitations of Prompt Tuningcited by 30
  24. 2021Self-supervised Autoregressive Domain Adaptation for Time Series Datacited by 29
  25. 2023Context-aware Domain Adaptation for Time Series Anomaly Detectioncited by 8
  26. 2020Multi-instance Domain Adaptation for Vaccine Adverse Event Detectioncited by 3

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 4.

6 papers.