mlsanityData to 14 Oct 2026

Invariant Representation Learning for Source-Free Time Series Forecasting with LLM-Centric Proxy Denoising

arXiv 2510.05589 ↗First posted 7 Oct 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Effective time series forecasting enables various real-world applications, benefiting from the proliferation of mobile devices. However, the volume of time series data may vary significantly across domains due to high data acquisition costs and data regulations. To maximally create value from sparse data, this study focuses on a new problem of source-free time series forecasting, aiming to adapt a pretrained model from sufficient source time series to the sparse target time series without access to the source data, enabling data protection. To achieve this, we propose TimeID, a novel source-free time series forecasting framework with a large language model (LLM) centric proxy denoising inspired by the powerful generalization capabilities of LLMs. Specifically, TimeID consists of three key components: (1) dual-branch invariant disentangled feature learning that enforces representation- and gradient-wise invariance by means of season-trend decomposition; (2) lightweight, parameter-free proxy denoising that dynamically calibrates systematic biases of LLMs; and (3) knowledge distillation that bidirectionally aligns the denoised prediction and the original target prediction. Extensive experiments on real-world datasets demonstrate that TimeID outperforms state-of-the-art baselines, improving MSE and MAE by 10.7% and 9.3% on average. The code is available at https://github.com/decisionintelligence/TimeID.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 83 references that are in the map. First posted on arXiv 7 Oct 2025.

Builds on

47 of 83 references.

References · 47

  1. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  2. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  3. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  4. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  5. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  6. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  7. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  8. 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 848
  9. 2024Chronos: Learning the Language of Time Seriescited by 759
  10. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  11. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  12. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
35 more
  1. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
  2. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  3. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  4. 2020Universal Source-Free Domain Adaptationcited by 220
  5. 2021Exploiting the Intrinsic Neighborhood Structure for Source-free Domain Adaptationcited by 177
  6. 2023UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecastingcited by 144
  7. 2020Learning explanations that are hard to varycited by 132
  8. 2020Deep Learning for Time Series Forecasting: Tutorial and Literature Surveycited by 117
  9. 2024CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuningcited by 108
  10. 2023A Comprehensive Survey on Source-free Domain Adaptationcited by 104
  11. 2024TimeCMA: Towards LLM-Empowered Multivariate Time Series Forecasting via Cross-Modality Alignmentcited by 103
  12. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 94
  13. 2020Domain Adaptation without Source Datacited by 88
  14. 2020Multi-Source Deep Domain Adaptation with Weak Supervision for Time-Series Sensor Datacited by 82
  15. 2022Source-Free Unsupervised Domain Adaptation: A Surveycited by 80
  16. 2022Towards Spatio-Temporal Aware Traffic Time Series Forecasting--Full Versioncited by 59
  17. 2020Time Series Domain Adaptation via Sparse Associative Structure Alignmentcited by 51
  18. 2023LightPath: Lightweight and Scalable Path Representation Learningcited by 32
  19. 2024Towards a General Time Series Forecasting Model with Unified Representation and Adaptive Transfercited by 32
  20. 2025LightGTS: A Lightweight General Time Series Forecasting Modelcited by 29
  21. 2025Aurora: Towards Universal Generative Multimodal Time Series Forecastingcited by 29
  22. 2024AirPhyNet: Harnessing Physics-Guided Neural Networks for Air Quality Predictioncited by 26
  23. 2024Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecastingcited by 26
  24. 2024Hierarchical Classification Auxiliary Network for Time Series Forecastingcited by 26
  25. 2024WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecastingcited by 26
  26. 2024Proxy Denoising for Source-Free Domain Adaptationcited by 21
  27. 2025Efficient Multivariate Time Series Forecasting via Calibrated Language Models with Privileged Knowledge Distillationcited by 20
  28. 2025BLAST: Balanced Sampling Time Series Corpus for Universal Forecasting Modelscited by 16
  29. 2023Source-Free Domain Adaptation with Temporal Imputation for Time Series Datacited by 15
  30. 2025TimeEmb: A Lightweight Static-Dynamic Disentanglement Framework for Time Series Forecastingcited by 12
  31. 2024TEAM: Topological Evolution-aware Framework for Traffic Forecasting--Extended Versioncited by 10
  32. 2023MASK-CNN-Transformer For Real-Time Multi-Label Weather Recognitioncited by 8
  33. 2024QCore: Data-Efficient, On-Device Continual Calibration for Quantized Models -- Extended Versioncited by 7
  34. 2024Evidentially Calibrated Source-Free Time-Series Domain Adaptation with Temporal Imputationcited by 6
  35. 2025Moment Alignment: Unifying Gradient and Hessian Matching for Domain Generalizationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Generative Time Series Forecasting with Diffusion, Denoise, and Disentanglement
  2. 2024Sparse-VQ Transformer: An FFN-Free Framework with Vector Quantization for Enhanced Time Series Forecasting
  3. 2024Conditional Denoising Meets Polynomial Modeling: A Flexible Decoupled Framework for Time Series Forecasting
  4. 2024SDE: A Simplified and Disentangled Dependency Encoding Framework for State Space Models in Time Series Forecasting
  5. 2023LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasters
  6. 2025Small but Mighty: Enhancing Time Series Forecasting with Lightweight LLMs
  7. 2026Enhancing few-shot time series forecasting with LLM-guided diffusion
  8. 2026MoHETS: Long-term Time Series Forecasting with Mixture-of-Heterogeneous-Experts