TRACE: Time SeRies PArameter EffiCient FinE-tuning
Not on the map. Why?
Abstract (arXiv)
We propose an efficient fine-tuning method for time series foundation models, termed TRACE: Time Series Parameter Efficient Fine-tuning. While pretrained time series foundation models are gaining popularity, they face the following challenges: (1) Unlike natural language tasks, time series data vary in frequency, channel numbers, historical/prediction lengths. For long-term forecasting tasks in particular, tailored fine-tuning can significantly enhance performance.(2) Existing parameter-efficient tuning methods like LoRA remain applicable but require adaptation to temporal characteristics. To address these challenges, our TRACE framework introduces two key innovations: (1) Gated DSIC (Gated Dynamic Simulation Importance Calculation), an unbiased LoRA module importance selection mechanism that ensures conditional parameter consistency before and after masking. Experiments demonstrate that Gated DSIC outperforms common fine-tuning. (2) Reconstructed prediction heads for long-term forecasting tasks, which achieve comparable or superior performance to linear probing heads while drastically reducing parameter counts. Extensive experiments on long-/short-term forecasting, anomaly detection and natural language tasks across diverse datasets, coupled with ablation studies, validate the effectiveness of our method.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 21 Mar 2025.
Builds on
24 of 38 references.
References · 24
- 2017Attention Is All You Needcited by 60,361
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2020GLU Variants Improve Transformercited by 1,804
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
12 more
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 508
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
- 2022Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Modelscited by 180
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
- 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 169
- 2020Meta-learning framework with applications to zero-shot time-series forecastingcited by 70
- 2022Shapley Head Pruning: Identifying and Removing Interference in Multilingual Transformerscited by 9
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2026Post-Training in Time Series Foundation Models: A Unifying Frameworkcited by 3
- 2025Estimating Time Series Foundation Model Transferability via In-Context Learningcited by 2
- 2026LLM-based Agents for Forecasting and Prediction: Methods, Training, Evaluation, and Applicationscited by 1
- 2025Dynamic Perturbed Adaptive Method for Infinite Task-Conflicting Time Seriescited by 0
- 2026Volatility-Clustering Adaptation for Financial Time Seriescited by 0
- 2026Raw-Routed Mixture of Adapters: A Causal Intervention for Routing Collapse in Time Series Foundation Modelscited by 0
- 2026Raw-Routed Mixture of Adapters: A Causal Intervention for Routing Collapse in Time Series Foundation Models30 Sep 2026
- 2026Volatility-Clustering Adaptation for Financial Time Series29 Sep 2026
- 2026LLM-based Agents for Forecasting and Prediction: Methods, Training, Evaluation, and Applications24 Aug 2026
- 2026Post-Training in Time Series Foundation Models: A Unifying Framework22 Jul 2026
- 2025Estimating Time Series Foundation Model Transferability via In-Context Learning28 Sep 2025
- 2025Dynamic Perturbed Adaptive Method for Infinite Task-Conflicting Time Series17 May 2025