DDTime: Dataset Distillation with Spectral Alignment and Information Bottleneck for Time-Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Time-series forecasting is fundamental across many domains, yet training accurate models often requires large-scale datasets and substantial computational resources. Dataset distillation offers a promising alternative by synthesizing compact datasets that preserve the learning behavior of full data. However, extending dataset distillation to time-series forecasting is non-trivial due to two fundamental challenges: 1.temporal bias from strong autocorrelation, which leads to distorted value-term alignment between teacher and student models; and 2.insufficient diversity among synthetic samples, arising from the absence of explicit categorical priors to regularize trajectory variety. In this work, we propose DDTime, a lightweight and plug-in distillation framework built upon first-order condensation decomposition. To tackle Challenge 1, it revisits value-term alignment through temporal statistics and introduces a frequency-domain alignment mechanism to mitigate autocorrelation-induced bias, ensuring spectral consistency and temporal fidelity. To address Challenge 2, we further design an inter-sample regularization inspired by the information bottleneck principle, which enhances diversity and maximizes information density across synthetic trajectories. The combined objective is theoretically compatible with a wide range of condensation paradigms and supports stable first-order optimization. Extensive experiments on 20 benchmark datasets and diverse forecasting architectures demonstrate that DDTime consistently outperforms existing distillation methods, achieving about 30% relative accuracy gains while introducing about 2.49% computational overhead. All code and distilled datasets will be released.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Nov 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Bridging Reasoning Trajectories in On-Policy Distillation via Near-Future Guidancecited by 13
- 2026Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillationcited by 11
- 2026History-informed Lagrangian Neural Networkscited by 1
- 2026Decision-Oriented Uncertainty Quantification for Risk Control in Earth System Spatiotemporal Foundation Modelscited by 0
- 2026MedTRACE: Tool-Augmented Multimodal Clinical Reasoning Agents for Evidence-Grounded Decision-Makingcited by 0
- 2026AsyncCouple-Flow: Asynchronous Cross-Modal Coupling and Flow Matching for Spatio-Temporal Forecastingcited by 0
- 2026CoRe: Coherence and Relational Alignment for Multivariate Time Series Forecastingcited by 0
- 2026CoRe: Coherence and Relational Alignment for Multivariate Time Series Forecasting17 Sep 2026
- 2026AsyncCouple-Flow: Asynchronous Cross-Modal Coupling and Flow Matching for Spatio-Temporal Forecasting15 Sep 2026
- 2026MedTRACE: Tool-Augmented Multimodal Clinical Reasoning Agents for Evidence-Grounded Decision-Making13 Sep 2026
- 2026Decision-Oriented Uncertainty Quantification for Risk Control in Earth System Spatiotemporal Foundation Models13 Sep 2026
- 2026History-informed Lagrangian Neural Networks13 Aug 2026
- 2026Bridging Reasoning Trajectories in On-Policy Distillation via Near-Future Guidance29 May 2026
- 2026Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillation10 May 2026