mlsanityData to 14 Oct 2026

Prompting-based Temporal Domain Generalization

arXiv 2310.02473 ↗First posted 3 Oct 2023cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine learning traditionally assumes that the training and testing data are distributed independently and identically. However, in many real-world settings, the data distribution can shift over time, leading to poor generalization of trained models in future time periods. This paper presents a novel prompting-based approach to temporal domain generalization that is parameter-efficient, time-efficient, and does not require access to future data during training. Our method adapts a trained model to temporal drift by learning global prompts, domain-specific prompts, and drift-aware prompts that capture underlying temporal dynamics. Experiments on classification, regression, and time series forecasting tasks demonstrate the generality of the proposed approach. The code repository will be publicly shared.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 53 of its 71 references that are in the map. First posted on arXiv 3 Oct 2023.

Builds on

53 of 71 references.

References · 53

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  4. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  6. 2018Deep contextualized word representationscited by 2,290
  7. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  8. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  9. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
  10. 2017Adversarial Discriminative Domain Adaptationcited by 1,311
  11. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
  12. 2019How Can We Know What Language Models Know?cited by 959
38 more
  1. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
  2. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
  3. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
  4. 2021GPT Understands, Toocited by 716
  5. 2018Deep Visual Domain Adaptation: A Surveycited by 635
  6. 2015Optimal Transport for Domain Adaptationcited by 463
  7. 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
  8. 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 319
  9. 2020Learning to Learn Single Domain Generalizationcited by 296
  10. 2018Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomizationcited by 294
  11. 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
  12. 2019Domain Randomization and Pyramid Consistency: Simulation-to-Real Generalization without Accessing Target Domain Datacited by 246
  13. 2021SPoT: Better Frozen Model Adaptation through Soft Prompt Transfercited by 235
  14. 2021PPT: Pre-trained Prompt Tuning for Few-shot Learningcited by 232
  15. 2020Deep Domain-Adversarial Image Generation for Domain Generalisationcited by 231
  16. 2020Representation Learning via Invariant Causal Mechanismscited by 199
  17. 2021How Many Data Points is a Prompt Worth?cited by 198
  18. 2021Fishr: Invariant Gradient Variances for Out-of-Distribution Generalizationcited by 186
  19. 2023Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learningcited by 115
  20. 2020Learning to Generalize Unseen Domains via Memory-based Multi-Source Meta-Learning for Person Re-Identificationcited by 110
  21. 2018Structured Domain Randomization: Bridging the Reality Gap by Context-Aware Synthetic Datacited by 94
  22. 2021Adversarially Adaptive Normalization for Single Domain Generalizationcited by 85
  23. 2022ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Promptscited by 85
  24. 2021BERTese: Learning to Speak to BERTcited by 82
  25. 2020Continuously Indexed Domain Adaptationcited by 75
  26. 2021On Transferability of Prompt Tuning for Natural Language Processingcited by 75
  27. 2021Adaptive Methods for Real-World Domain Generalizationcited by 66
  28. 2018A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulationcited by 62
  29. 2021Learning a Universal Template for Few-shot Dataset Generalizationcited by 61
  30. 2022Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecastingcited by 54
  31. 2020Meta-Learning for Domain Generalization in Semantic Parsingcited by 41
  32. 2022Temporal Domain Generalization with Drift-Aware Dynamic Neural Networkscited by 33
  33. 2019AdaGraph: Unifying Predictive and Continuous Domain Adaptation through Graphscited by 32
  34. 2021Training for the Future: A Simple Gradient Interpolation Loss to Generalize Along Timecited by 28
  35. 2018Domain Randomization for Scene-Specific Car Detection and Pose Estimationcited by 23
  36. 2020Continuous Domain Adaptation with Variational Domain-Agnostic Feature Replaycited by 19
  37. 2021Neuron Coverage-Guided Domain Generalizationcited by 19
  38. 2020Learn to Expect the Unexpected: Probably Approximately Correct Domain Generalizationcited by 14

50 most cited of 53 All 53 (JSON)

Built on by

Not cited yet.