mlsanityData to 14 Oct 2026

Lightweight Time Series Data Valuation on Time Series Foundation Models via In-Context Finetuning

arXiv 2511.11648 ↗First posted 10 Nov 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Time series foundation models (TSFMs) have demonstrated increasing capabilities due to their extensive pretraining on large volumes of diverse time series data. Consequently, the quality of time series data is crucial to TSFM performance, rendering an accurate and efficient data valuation of time series for TSFMs indispensable. However, traditional data valuation methods, such as influence functions, face severe computational bottlenecks due to their poor scalability with growing TSFM model sizes and often fail to preserve temporal dependencies. In this paper, we propose LTSV, a Lightweight Time Series Valuation on TSFMS via in-context finetuning. Grounded in the theoretical evidence that in-context finetuning approximates the influence function, LTSV estimates a sample's contribution by measuring the change in context loss after in-context finetuning, leveraging the strong generalization capabilities of TSFMs to produce robust and transferable data valuations. To capture temporal dependencies, we introduce temporal block aggregation, which integrates per-block influence scores across overlapping time windows. Experiments across multiple time series datasets and models demonstrate that LTSV consistently provides reliable and strong valuation performance, while maintaining manageable computational requirements. Our results suggest that in-context finetuning on time series foundation models provides a practical and effective bridge between data attribution and model generalization in time series learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 49 references that are in the map. First posted on arXiv 10 Nov 2025.

Builds on

36 of 49 references.

References · 36

  1. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  3. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  4. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  5. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
  6. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
  7. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  8. 2023A decoder-only foundation model for time-series forecastingcited by 692
  9. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  10. 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
  11. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  12. 2023Data Selection for Language Models via Importance Resamplingcited by 329
24 more
  1. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
  2. 2020Influence Functions in Deep Learning Are Fragilecited by 252
  3. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
  4. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
  5. 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 168
  6. 2023TimeGPT-1cited by 158
  7. 2024QuRating: Selecting High-Quality Data for Training Language Modelscited by 157
  8. 2023D4: Improving LLM Pretraining via Document De-Duplication and Diversificationcited by 150
  9. 2024MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Modelscited by 100
  10. 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 95
  11. 2024How to Train Data-Efficient LLMscited by 93
  12. 2024Timer-XL: Long-Context Transformers for Unified Time Series Forecastingcited by 87
  13. 2020TimeSHAP: Explaining Recurrent Models through Sequence Perturbationscited by 74
  14. 2023In-context Example Selection with Influencescited by 61
  15. 2023Data-OOB: Out-of-bag Estimate as a Simple and Efficient Data Valuecited by 38
  16. 2024Time-Series Forecasting for Out-of-Distribution Generalization Using Invariant Learningcited by 27
  17. 2022WindowSHAP: An Efficient Framework for Explaining Time-series Classifiers based on Shapley Valuescited by 24
  18. 2025ChronosX: Adapting Pretrained Time Series Models with Exogenous Variablescited by 23
  19. 2023In-Context Demonstration Selection with Cross Entropy Differencecited by 17
  20. 2023BayOTIDE: Bayesian Online Multivariate Time series Imputation with functional decompositioncited by 10
  21. 2025Fairshare Data Pricing via Data Valuation for Large Language Modelscited by 8
  22. 2024TimeInf: Time Series Data Contribution via Influence Functionscited by 6
  23. 2025Unifying Prediction and Explanation in Time-Series Transformers via Shapley-based Pretrainingcited by 5
  24. 20242D-OOB: Attributing Data Contribution Through Joint Valuation Frameworkcited by 4

Built on by

Not cited yet.