mlsanityData to 7 Oct 2026

Self-attention-based Diffusion Model for Time-series Imputation in Partial Blackout Scenarios

arXiv 2503.01737 ↗First posted 3 Mar 2025cs.LG stat.MLcited by 5

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Missing values in multivariate time series data can harm machine learning performance and introduce bias. These gaps arise from sensor malfunctions, blackouts, and human error and are typically addressed by data imputation. Previous work has tackled the imputation of missing data in random, complete blackouts and forecasting scenarios. The current paper addresses a more general missing pattern, which we call "partial blackout," where a subset of features is missing for consecutive time steps. We introduce a two-stage imputation process using self-attention and diffusion processes to model feature and temporal correlations. Notably, our model effectively handles missing data during training, enhancing adaptability and ensuring reliable imputation and performance, even with incomplete datasets. Our experiments on benchmark and two real-world time series datasets demonstrate that our model outperforms the state-of-the-art in partial blackout scenarios and shows better scalability.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 16 of its 29 references that are in the map. First posted on arXiv 3 Mar 2025.

Builds on

16 of 29 references.

Closest ancestors · 2

Same direction, newest first

  1. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation7 Jul
  2. 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting28 Jan

Other references · 14

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  6. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  7. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  8. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
  9. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 548
  10. 2019GP-VAE: Deep Probabilistic Time Series Imputationcited by 171
  11. 2022SAITS: Self-Attention-based Imputation for Time Seriescited by 167
  12. 20233D-aware Image Generation using 2D Diffusion Modelscited by 69
2 more
  1. 2019NAOMI: Non-Autoregressive Multiresolution Sequence Imputationcited by 59
  2. 2018A Novel Bayesian Approach for Latent Variable Modeling from Mixed Data with Missing Valuescited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models
  2. 2026Modeling Information Blackouts in Missing Not-At-Random Time Series Data
  3. 2026Discretizing Continuous Time Series for Imputation with Masked Diffusion Training
  4. 2025Diffusion Transformers for Imputation: Statistical Efficiency and Uncertainty Quantification
  5. 2025Filling the Missings: Spatiotemporal Data Imputation by Conditional Diffusion
  6. 2023sasdim: self-adaptive noise scaling diffusion model for spatial time series imputation
  7. 2024Latent Space Score-based Diffusion Model for Probabilistic Multivariate Time Series Imputation
  8. 2024RDPI: A Refine Diffusion Probability Generation Method for Spatiotemporal Data Imputation