POND: Multi-Source Time Series Domain Adaptation with Information-Aware Prompt Tuning
Not on the map. Why?
Abstract (arXiv)
Time series domain adaptation stands as a pivotal and intricate challenge with diverse applications, including but not limited to human activity recognition, sleep stage classification, and machine fault diagnosis. Despite the numerous domain adaptation techniques proposed to tackle this complex problem, they primarily focus on domain adaptation from a single source domain. Yet, it is more crucial to investigate domain adaptation from multiple domains due to the potential for greater improvements. To address this, three important challenges need to be overcome: 1). The lack of exploration to utilize domain-specific information for domain adaptation, 2). The difficulty to learn domain-specific information that changes over time, and 3). The difficulty to evaluate learned domain-specific information. In order to tackle these challenges simultaneously, in this paper, we introduce PrOmpt-based domaiN Discrimination (POND), the first framework to utilize prompts for time series domain adaptation. Specifically, to address Challenge 1, we extend the idea of prompt tuning to time series analysis and learn prompts to capture common and domain-specific information from all source domains. To handle Challenge 2, we introduce a conditional module for each source domain to generate prompts from time series input data. For Challenge 3, we propose two criteria to select good prompts, which are used to choose the most suitable source domain for domain adaptation. The efficacy and robustness of our proposed POND model are extensively validated through experiments across 50 scenarios encompassing four datasets. Experimental results demonstrate that our proposed POND model outperforms all state-of-the-art comparison methods by up to 66% on the F1-score.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 38 of its 55 references that are in the map. First posted on arXiv 19 Dec 2023.
Builds on
38 of 55 references.
References · 38
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2023A Survey of Large Language Modelscited by 2,576
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
- 2018On First-Order Meta-Learning Algorithmscited by 1,018
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 737
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2019On Variational Bounds of Mutual Informationcited by 559
26 more
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
- 2021TS2Vec: Towards Universal Representation of Time Seriescited by 471
- 2020CLUB: A Contrastive Log-ratio Upper Bound of Mutual Informationcited by 235
- 2018A DIRT-T Approach to Unsupervised Domain Adaptationcited by 215
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
- 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 172
- 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 169
- 2023Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Surveycited by 135
- 2021Deep Subdomain Adaptation Network for Image Classificationcited by 119
- 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 110
- 2019Domain Agnostic Learning with Disentangled Representationscited by 108
- 2022Unsupervised Time-Series Representation Learning with Iterative Bilinear Temporal-Spectral Fusioncited by 96
- 2020Multi-Source Deep Domain Adaptation with Weak Supervision for Time-Series Sensor Datacited by 82
- 2021Domain Adaptation for Time Series Forecasting via Attention Sharingcited by 68
- 2023Domain Adaptation for Time Series Under Feature and Label Shiftscited by 60
- 2023Time Series Contrastive Learning with Information-Aware Augmentationscited by 52
- 2020Time Series Domain Adaptation via Sparse Associative Structure Alignmentcited by 51
- 2020Multi-source Domain Adaptation in the Deep Learning Era: A Systematic Surveycited by 47
- 2022ADATIME: A Benchmarking Suite for Domain Adaptation on Time Series Datacited by 45
- 2022IDPG: An Instance-Dependent Prompt Generation Methodcited by 43
- 2019On Minimum Discrepancy Estimation for Deep Domain Adaptationcited by 34
- 2022Temporal Domain Generalization with Drift-Aware Dynamic Neural Networkscited by 33
- 2023Universality and Limitations of Prompt Tuningcited by 30
- 2021Self-supervised Autoregressive Domain Adaptation for Time Series Datacited by 29
- 2023Context-aware Domain Adaptation for Time Series Anomaly Detectioncited by 8
- 2020Multi-instance Domain Adaptation for Vaccine Adverse Event Detectioncited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 4.
6 papers.
- 2024Evidentially Calibrated Source-Free Time-Series Domain Adaptation with Temporal Imputationcited by 6
- 2024Temporal Source Recovery for Time-Series Source-Free Unsupervised Domain Adaptationcited by 4
- 2025UPRE: Zero-Shot Domain Adaptation for Object Detection via Unified Prompt and Representation Enhancementcited by 4
- 2025Temporal Restoration and Spatial Rewiring for Source-Free Multivariate Time Series Domain Adaptationcited by 2
- 2025Learning Compositional Transferability of Time Series for Source-Free Domain Adaptationcited by 0
- 2025Spatial Imputation Drives Cross-Domain Alignment for EEG Classificationcited by 0
- 2025Spatial Imputation Drives Cross-Domain Alignment for EEG Classification5 Aug 2025
- 2025UPRE: Zero-Shot Domain Adaptation for Object Detection via Unified Prompt and Representation Enhancement1 Jul 2025
- 2025Temporal Restoration and Spatial Rewiring for Source-Free Multivariate Time Series Domain Adaptation23 May 2025
- 2025Learning Compositional Transferability of Time Series for Source-Free Domain Adaptation21 Apr 2025
- 2024Temporal Source Recovery for Time-Series Source-Free Unsupervised Domain Adaptation29 Sep 2024
- 2024Evidentially Calibrated Source-Free Time-Series Domain Adaptation with Temporal Imputation4 Jun 2024