Self-attention-based Diffusion Model for Time-series Imputation in Partial Blackout Scenarios
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Missing values in multivariate time series data can harm machine learning performance and introduce bias. These gaps arise from sensor malfunctions, blackouts, and human error and are typically addressed by data imputation. Previous work has tackled the imputation of missing data in random, complete blackouts and forecasting scenarios. The current paper addresses a more general missing pattern, which we call "partial blackout," where a subset of features is missing for consecutive time steps. We introduce a two-stage imputation process using self-attention and diffusion processes to model feature and temporal correlations. Notably, our model effectively handles missing data during training, enhancing adaptability and ensuring reliable imputation and performance, even with incomplete datasets. Our experiments on benchmark and two real-world time series datasets demonstrate that our model outperforms the state-of-the-art in partial blackout scenarios and shows better scalability.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 16 of its 29 references that are in the map. First posted on arXiv 3 Mar 2025.
Builds on
16 of 29 references.
Closest ancestors · 2
Same direction, newest first
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation7 Jul
- 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting28 Jan
Other references · 14
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
- 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 548
- 2019GP-VAE: Deep Probabilistic Time Series Imputationcited by 171
- 2022SAITS: Self-Attention-based Imputation for Time Seriescited by 167
- 20233D-aware Image Generation using 2D Diffusion Modelscited by 69
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025Step-Aware Residual-Guided Diffusion for EEG Spatial Super-Resolutioncited by 5
- 2025Beyond Observations: Reconstruction Error-Guided Irregularly Sampled Time Series Representation Learningcited by 1
- 2025Masked Training for Robust Arrhythmia Detection from Digitalized Multiple Layout ECG Imagescited by 0
- 2026EMAG: Differentiable 4D Gaussian Mixture Splatting for EEG Spatial Super-Resolutioncited by 0
- 2026GAUDI: Geometry-Aware Diffusion for Calibrated Air-Quality Time-Series Imputationcited by 0
- 2026GAUDI: Geometry-Aware Diffusion for Calibrated Air-Quality Time-Series Imputation24 Sep 2026
- 2026EMAG: Differentiable 4D Gaussian Mixture Splatting for EEG Spatial Super-Resolution28 May 2026
- 2025Beyond Observations: Reconstruction Error-Guided Irregularly Sampled Time Series Representation Learning10 Nov 2025
- 2025Step-Aware Residual-Guided Diffusion for EEG Spatial Super-Resolution22 Oct 2025
- 2025Masked Training for Robust Arrhythmia Detection from Digitalized Multiple Layout ECG Images6 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models
- 2026Modeling Information Blackouts in Missing Not-At-Random Time Series Data
- 2026Discretizing Continuous Time Series for Imputation with Masked Diffusion Training
- 2025Diffusion Transformers for Imputation: Statistical Efficiency and Uncertainty Quantification
- 2025Filling the Missings: Spatiotemporal Data Imputation by Conditional Diffusion
- 2023sasdim: self-adaptive noise scaling diffusion model for spatial time series imputation
- 2024Latent Space Score-based Diffusion Model for Probabilistic Multivariate Time Series Imputation
- 2024RDPI: A Refine Diffusion Probability Generation Method for Spatiotemporal Data Imputation