Lightweight Time Series Data Valuation on Time Series Foundation Models via In-Context Finetuning
Not on the map. Why?
Abstract (arXiv)
Time series foundation models (TSFMs) have demonstrated increasing capabilities due to their extensive pretraining on large volumes of diverse time series data. Consequently, the quality of time series data is crucial to TSFM performance, rendering an accurate and efficient data valuation of time series for TSFMs indispensable. However, traditional data valuation methods, such as influence functions, face severe computational bottlenecks due to their poor scalability with growing TSFM model sizes and often fail to preserve temporal dependencies. In this paper, we propose LTSV, a Lightweight Time Series Valuation on TSFMS via in-context finetuning. Grounded in the theoretical evidence that in-context finetuning approximates the influence function, LTSV estimates a sample's contribution by measuring the change in context loss after in-context finetuning, leveraging the strong generalization capabilities of TSFMs to produce robust and transferable data valuations. To capture temporal dependencies, we introduce temporal block aggregation, which integrates per-block influence scores across overlapping time windows. Experiments across multiple time series datasets and models demonstrate that LTSV consistently provides reliable and strong valuation performance, while maintaining manageable computational requirements. Our results suggest that in-context finetuning on time series foundation models provides a practical and effective bridge between data attribution and model generalization in time series learning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 49 references that are in the map. First posted on arXiv 10 Nov 2025.
Builds on
36 of 49 references.
References · 36
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
- 2023Data Selection for Language Models via Importance Resamplingcited by 329
24 more
- 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
- 2020Influence Functions in Deep Learning Are Fragilecited by 252
- 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
- 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
- 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 168
- 2023TimeGPT-1cited by 158
- 2024QuRating: Selecting High-Quality Data for Training Language Modelscited by 157
- 2023D4: Improving LLM Pretraining via Document De-Duplication and Diversificationcited by 150
- 2024MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Modelscited by 100
- 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 95
- 2024How to Train Data-Efficient LLMscited by 93
- 2024Timer-XL: Long-Context Transformers for Unified Time Series Forecastingcited by 87
- 2020TimeSHAP: Explaining Recurrent Models through Sequence Perturbationscited by 74
- 2023In-context Example Selection with Influencescited by 61
- 2023Data-OOB: Out-of-bag Estimate as a Simple and Efficient Data Valuecited by 38
- 2024Time-Series Forecasting for Out-of-Distribution Generalization Using Invariant Learningcited by 27
- 2022WindowSHAP: An Efficient Framework for Explaining Time-series Classifiers based on Shapley Valuescited by 24
- 2025ChronosX: Adapting Pretrained Time Series Models with Exogenous Variablescited by 23
- 2023In-Context Demonstration Selection with Cross Entropy Differencecited by 17
- 2023BayOTIDE: Bayesian Online Multivariate Time series Imputation with functional decompositioncited by 10
- 2025Fairshare Data Pricing via Data Valuation for Large Language Modelscited by 8
- 2024TimeInf: Time Series Data Contribution via Influence Functionscited by 6
- 2025Unifying Prediction and Explanation in Time-Series Transformers via Shapley-based Pretrainingcited by 5
- 20242D-OOB: Attributing Data Contribution Through Joint Valuation Frameworkcited by 4
Built on by
Not cited yet.