DDT: A Dual-Masking Dual-Expert Transformer for Energy Time-Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Accurate energy time-series forecasting is crucial for ensuring grid stability and promoting the integration of renewable energy, yet it faces significant challenges from complex temporal dependencies and the heterogeneity of multi-source data. To address these issues, we propose DDT, a novel and robust deep learning framework for high-precision time-series forecasting. At its core, DDT introduces two key innovations. First, we design a dual-masking mechanism that synergistically combines a strict causal mask with a data-driven dynamic mask. This novel design ensures theoretical causal consistency while adaptively focusing on the most salient historical information, overcoming the rigidity of traditional masking techniques. Second, our architecture features a dual-expert system that decouples the modeling of temporal dynamics and cross-variable correlations into parallel, specialized pathways, which are then intelligently integrated through a dynamic gated fusion module. We conducted extensive experiments on 7 challenging energy benchmark datasets, including ETTh, Electricity, and Solar. The results demonstrate that DDT consistently outperforms strong state-of-the-art baselines across all prediction horizons, establishing a new benchmark for the task.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 43 references that are in the map. First posted on arXiv 12 Jan 2026.
Builds on
24 of 43 references.
References · 24
- 2017Attention Is All You Needcited by 60,361
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2014Conditional Generative Adversarial Netscited by 2,162
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2023A decoder-only foundation model for time-series forecastingcited by 692
12 more
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
- 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 338
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
- 2022N-HiTS: Neural Hierarchical Interpolation for Time Series Forecastingcited by 146
- 2024Pathformer: Multi-scale Transformers with Adaptive Pathways for Time Series Forecastingcited by 104
- 2023LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation -- Extended Versioncited by 50
- 2024CausalFormer: An Interpretable Transformer for Temporal Causal Discoverycited by 17
- 2024TimeRAF: Retrieval-Augmented Foundation model for Zero-shot Time Series Forecastingcited by 17
- 2024Attention as Robust Representation for Time Series Forecastingcited by 4
- 2022Gaussian Process Latent Variable Modeling for Few-shot Time Series Forecastingcited by 3
- 2025Dynamic Causal Structure Discovery and Causal Effect Estimationcited by 3
- 2025Towards Lightweight Time Series Forecasting: a Patch-wise Transformer with Weak Data Enrichingcited by 3
Built on by
Not cited yet.