DDG-DA: Data Distribution Generation for Predictable Concept Drift Adaptation
Not on the map. Why?
Abstract (arXiv)
In many real-world scenarios, we often deal with streaming data that is sequentially collected over time. Due to the non-stationary nature of the environment, the streaming data distribution may change in unpredictable ways, which is known as concept drift. To handle concept drift, previous methods first detect when/where the concept drift happens and then adapt models to fit the distribution of the latest data. However, there are still many cases that some underlying factors of environment evolution are predictable, making it possible to model the future concept drift trend of the streaming data, while such cases are not fully explored in previous work. In this paper, we propose a novel method DDG-DA, that can effectively forecast the evolution of data distribution and improve the performance of models. Specifically, we first train a predictor to estimate the future data distribution, then leverage it to generate training samples, and finally train models on the generated data. We conduct experiments on three real-world tasks (forecasting on stock price trend, electricity load and solar irradiance) and obtain significant improvement on multiple widely-used models.
Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Builds on 16 of its 52 references that are in the map. First posted on arXiv 11 Jan 2022.
Builds on
16 of 52 references.
References · 16
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
- 2020Learning under Concept Drift: A Reviewcited by 477
- 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
- 2018Meta-learning with differentiable closed-form solverscited by 397
- 2015Gradient-based Hyperparameter Optimization through Reversible Learningcited by 360
- 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
- 2018CatBoost: gradient boosting with categorical features supportcited by 208
- 2017Online Learning Rate Adaptation with Hypergradient Descentcited by 118
- 2016On Differentiating Parameterized Argmin and Argmax Problems with Application to Bi-level Optimizationcited by 112
- 2015Characterizing Concept Driftcited by 94
- 2020Qlib: An AI-oriented Quantitative Investment Platformcited by 81
4 more
- 2019AlphaStock: A Buying-Winners-and-Selling-Losers Investment Strategy using Interpretable Deep Reinforcement Attention Networkscited by 40
- 2018Handling Concept Drift via Model Reusecited by 15
- 2014Automatic Differentiation of Algorithms for Machine Learningcited by 7
- 2020Learning to Reweight with Deep Interactionscited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 7; 2024: 14; 2025: 10; 2026: 4.
36 papers.
Sort:
By area:
- 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 107
- 2023OneNet: Enhancing Time Series Forecasting Models under Concept Drift by Online Ensemblingcited by 74
- 2024Frequency Adaptive Normalization For Non-stationary Time Series Forecastingcited by 47
- 2025Non-stationary Diffusion For Probabilistic Time Series Forecastingcited by 27
- 2023DoubleAdapt: A Meta-learning Approach to Incremental Learning for Stock Trend Forecastingcited by 21
- 2024Adapting Multi-modal Large Language Model to Concept Drift From Pre-training Onwardscited by 19
- 2024Proactive Model Adaptation Against Concept Drift for Online Time Series Forecastingcited by 19
- 2023Online Boosting Adaptive Learning under Concept Drift for Multistream Classificationcited by 17
- 2024Continuous Temporal Domain Generalizationcited by 15
- 2025Drift-aware Collaborative Assistance Mixture of Experts for Heterogeneous Multistream Learningcited by 14
- 2024Addressing Concept Shift in Online Time Series Forecasting: Detect-then-Adaptcited by 13
- 2024Classifier Clustering and Feature Alignment for Federated Learning under Distributed Concept Driftcited by 8
24 more
- 2024Early Concept Drift Detection via Prediction Uncertaintycited by 8
- 2022Distributional Drift Adaptation with Temporal Conditional Variational Autoencoder for Multivariate Time Series Forecastingcited by 7
- 2023MemDA: Forecasting Urban Time Series with Memory-based Drift Adaptationcited by 7
- 2025Resilient Contrastive Pre-training under Non-Stationary Driftcited by 7
- 2024Act Now: A Novel Online Forecasting Framework for Large-Scale Streaming Datacited by 6
- 2023Methods for Acquiring and Incorporating Knowledge into Stock Price Prediction: A Surveycited by 3
- 2025QuantBench: Benchmarking AI Methods for Quantitative Investmentcited by 2
- 2025Non-Stationary Time Series Forecasting Based on Fourier Analysis and Cross Attention Mechanismcited by 2
- 2025Continuous Domain Generalizationcited by 2
- 2025Neural MJD: Neural Non-Stationary Merton Jump Diffusion for Time Series Predictioncited by 2
- 2025EventTSF: Event-Aware Non-Stationary Time Series Forecastingcited by 2
- 2023An Adaptive Method for Weak Supervision with Drifting Datacited by 1
- 2023On the Three Demons in Causality in Finance: Time Resolution, Nonstationarity, and Latent Factorscited by 1
- 2024A Comprehensive Review of Machine Learning Advances on Data Change: A Cross-Field Perspectivecited by 1
- 2024QC-Forest: a Classical-Quantum Algorithm to Provably Speedup Retraining of Random Forestcited by 1
- 2024Introducing 'Inside' Out of Distributioncited by 1
- 2024Robust Multivariate Time Series Forecasting against Intra- and Inter-Series Transitional Shiftcited by 1
- 2025STaRFormer: Semi-Supervised Task-Informed Representation Learning via Dynamic Attention-Based Regional Masking for Sequential Datacited by 1
- 2026TimeAPN: Adaptive Amplitude-Phase Non-Stationarity Normalization for Time Series Forecastingcited by 1
- 2024Incorporating Long-term Data in Training Short-term Traffic Prediction Modelcited by 0
- 2025Wavelet-based Disentangled Adaptive Normalization for Non-stationary Times Series Forecastingcited by 0
- 2026History Is Not Enough: An Adaptive Dataflow System for Financial Time-Series Synthesiscited by 0
- 2026Autonomous Drift Learning in Data Streams: A Unified Perspectivecited by 0
- 2026CausalMoE: A Billion-Scale Multimodal Foundation Model for Granger Causal Discovery with Pattern-Routed Heterogeneous Expertscited by 0
- 2026CausalMoE: A Billion-Scale Multimodal Foundation Model for Granger Causal Discovery with Pattern-Routed Heterogeneous Experts11 Jun 2026
- 2026Autonomous Drift Learning in Data Streams: A Unified Perspective2 May 2026
- 2026TimeAPN: Adaptive Amplitude-Phase Non-Stationarity Normalization for Time Series Forecasting18 Mar 2026
- 2026History Is Not Enough: An Adaptive Dataflow System for Financial Time-Series Synthesis15 Jan 2026
- 2025EventTSF: Event-Aware Non-Stationary Time Series Forecasting19 Aug 2025
- 2025Drift-aware Collaborative Assistance Mixture of Experts for Heterogeneous Multistream Learning3 Aug 2025
- 2025Wavelet-based Disentangled Adaptive Normalization for Non-stationary Times Series Forecasting6 Jun 2025
- 2025Neural MJD: Neural Non-Stationary Merton Jump Diffusion for Time Series Prediction5 Jun 2025
- 2025Continuous Domain Generalization17 May 2025
- 2025Non-Stationary Time Series Forecasting Based on Fourier Analysis and Cross Attention Mechanism11 May 2025
- 2025Non-stationary Diffusion For Probabilistic Time Series Forecasting7 May 2025
- 2025QuantBench: Benchmarking AI Methods for Quantitative Investment24 Apr 2025
24 more
- 2025STaRFormer: Semi-Supervised Task-Informed Representation Learning via Dynamic Attention-Based Regional Masking for Sequential Data14 Apr 2025
- 2025Resilient Contrastive Pre-training under Non-Stationary Drift11 Feb 2025
- 2024Early Concept Drift Detection via Prediction Uncertainty15 Dec 2024
- 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecasting14 Dec 2024
- 2024Proactive Model Adaptation Against Concept Drift for Online Time Series Forecasting11 Dec 2024
- 2024Act Now: A Novel Online Forecasting Framework for Large-Scale Streaming Data28 Nov 2024
- 2024Classifier Clustering and Feature Alignment for Federated Learning under Distributed Concept Drift24 Oct 2024
- 2024Incorporating Long-term Data in Training Short-term Traffic Prediction Model16 Oct 2024
- 2024Frequency Adaptive Normalization For Non-stationary Time Series Forecasting30 Sep 2024
- 2024Robust Multivariate Time Series Forecasting against Intra- and Inter-Series Transitional Shift18 Jul 2024
- 2024Introducing 'Inside' Out of Distribution5 Jul 2024
- 2024QC-Forest: a Classical-Quantum Algorithm to Provably Speedup Retraining of Random Forest17 Jun 2024
- 2024Continuous Temporal Domain Generalization25 May 2024
- 2024Adapting Multi-modal Large Language Model to Concept Drift From Pre-training Onwards22 May 2024
- 2024Addressing Concept Shift in Online Time Series Forecasting: Detect-then-Adapt22 Mar 2024
- 2024A Comprehensive Review of Machine Learning Advances on Data Change: A Cross-Field Perspective20 Feb 2024
- 2023On the Three Demons in Causality in Finance: Time Resolution, Nonstationarity, and Latent Factors28 Dec 2023
- 2023Online Boosting Adaptive Learning under Concept Drift for Multistream Classification17 Dec 2023
- 2023MemDA: Forecasting Urban Time Series with Memory-based Drift Adaptation25 Sep 2023
- 2023OneNet: Enhancing Time Series Forecasting Models under Concept Drift by Online Ensembling22 Sep 2023
- 2023Methods for Acquiring and Incorporating Knowledge into Stock Price Prediction: A Survey9 Aug 2023
- 2023DoubleAdapt: A Meta-learning Approach to Incremental Learning for Stock Trend Forecasting16 Jun 2023
- 2023An Adaptive Method for Weak Supervision with Drifting Data2 Jun 2023
- 2022Distributional Drift Adaptation with Temporal Conditional Variational Autoencoder for Multivariate Time Series Forecasting1 Sep 2022
- 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 107
- 2023OneNet: Enhancing Time Series Forecasting Models under Concept Drift by Online Ensemblingcited by 74
- 2024Frequency Adaptive Normalization For Non-stationary Time Series Forecastingcited by 47
- 2023DoubleAdapt: A Meta-learning Approach to Incremental Learning for Stock Trend Forecastingcited by 21
- 2024Proactive Model Adaptation Against Concept Drift for Online Time Series Forecastingcited by 19
- 2023Online Boosting Adaptive Learning under Concept Drift for Multistream Classificationcited by 17
- 2024Continuous Temporal Domain Generalizationcited by 15
- 2024Addressing Concept Shift in Online Time Series Forecasting: Detect-then-Adaptcited by 13
- 2024Classifier Clustering and Feature Alignment for Federated Learning under Distributed Concept Driftcited by 8
- 2024Early Concept Drift Detection via Prediction Uncertaintycited by 8
- 2022Distributional Drift Adaptation with Temporal Conditional Variational Autoencoder for Multivariate Time Series Forecastingcited by 7
- 2023MemDA: Forecasting Urban Time Series with Memory-based Drift Adaptationcited by 7
12 most cited of 33 All 33 (JSON)
- 2026CausalMoE: A Billion-Scale Multimodal Foundation Model for Granger Causal Discovery with Pattern-Routed Heterogeneous Experts11 Jun 2026
- 2026Autonomous Drift Learning in Data Streams: A Unified Perspective2 May 2026
- 2026TimeAPN: Adaptive Amplitude-Phase Non-Stationarity Normalization for Time Series Forecasting18 Mar 2026
- 2026History Is Not Enough: An Adaptive Dataflow System for Financial Time-Series Synthesis15 Jan 2026
- 2025EventTSF: Event-Aware Non-Stationary Time Series Forecasting19 Aug 2025
- 2025Wavelet-based Disentangled Adaptive Normalization for Non-stationary Times Series Forecasting6 Jun 2025
- 2025Neural MJD: Neural Non-Stationary Merton Jump Diffusion for Time Series Prediction5 Jun 2025
- 2025Continuous Domain Generalization17 May 2025
- 2025Non-Stationary Time Series Forecasting Based on Fourier Analysis and Cross Attention Mechanism11 May 2025
- 2025QuantBench: Benchmarking AI Methods for Quantitative Investment24 Apr 2025
- 2025STaRFormer: Semi-Supervised Task-Informed Representation Learning via Dynamic Attention-Based Regional Masking for Sequential Data14 Apr 2025
- 2025Resilient Contrastive Pre-training under Non-Stationary Drift11 Feb 2025
12 newest of 33 All 33 (JSON)