mlsanityData to 14 Oct 2026

TRACE: Time SeRies PArameter EffiCient FinE-tuning

arXiv 2503.16991 ↗First posted 21 Mar 2025cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

We propose an efficient fine-tuning method for time series foundation models, termed TRACE: Time Series Parameter Efficient Fine-tuning. While pretrained time series foundation models are gaining popularity, they face the following challenges: (1) Unlike natural language tasks, time series data vary in frequency, channel numbers, historical/prediction lengths. For long-term forecasting tasks in particular, tailored fine-tuning can significantly enhance performance.(2) Existing parameter-efficient tuning methods like LoRA remain applicable but require adaptation to temporal characteristics. To address these challenges, our TRACE framework introduces two key innovations: (1) Gated DSIC (Gated Dynamic Simulation Importance Calculation), an unbiased LoRA module importance selection mechanism that ensures conditional parameter consistency before and after masking. Experiments demonstrate that Gated DSIC outperforms common fine-tuning. (2) Reconstructed prediction heads for long-term forecasting tasks, which achieve comparable or superior performance to linear probing heads while drastically reducing parameter counts. Extensive experiments on long-/short-term forecasting, anomaly detection and natural language tasks across diverse datasets, coupled with ablation studies, validate the effectiveness of our method.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 21 Mar 2025.

Builds on

24 of 38 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  5. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  6. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  7. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
  8. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  9. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  10. 2020GLU Variants Improve Transformercited by 1,804
  11. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  12. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
12 more
  1. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  2. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  3. 2023A decoder-only foundation model for time-series forecastingcited by 692
  4. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  5. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  6. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 508
  7. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  8. 2022Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Modelscited by 180
  9. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
  10. 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 169
  11. 2020Meta-learning framework with applications to zero-shot time-series forecastingcited by 70
  12. 2022Shapley Head Pruning: Identifying and Removing Interference in Multilingual Transformerscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.