mlsanityData to 7 Oct 2026

A Scale-Adaptive Framework for Joint Spatiotemporal Super-Resolution with Diffusion Models

arXiv 2604.21903 ↗First posted 23 Apr 2026cs.LG cs.AIcited by 1

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Deep-learning video super-resolution has progressed rapidly, but climate applications typically super-resolve (increase resolution) either space or time, and joint spatiotemporal models are often designed for a single pair of super-resolution (SR) factors (upscaling spatial and temporal ratio between the low-resolution sequence and the high-resolution sequence), limiting transfer across spatial resolutions and temporal cadences (frame rates). We present a scale-adaptive framework that reuses the same architecture across factors by decomposing spatiotemporal SR into a deterministic prediction of the conditional mean, with attention, and a residual conditional diffusion model, with an optional mass-conservation (same precipitation amount in inputs and outputs) transform to preserve aggregated totals. Assuming that larger SR factors primarily increase underdetermination (hence required context and residual uncertainty) rather than changing the conditional-mean structure, scale adaptivity is achieved by retuning three factor-dependent hyperparameters before retraining: the diffusion noise schedule amplitude beta (larger for larger factors to increase diversity), the temporal context length L (set to maintain comparable attention horizons across cadences) and optionally a third, the mass-conservation function f (tapered to limit the amplification of extremes for large factors). Demonstrated on reanalysis precipitation over France (Comephore), the same architecture spans super-resolution factors from 1 to 25 in space and 1 to 6 in time, yielding a reusable architecture and tuning recipe for joint spatiotemporal super-resolution across scales.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 11 of its 20 references that are in the map. First posted on arXiv 23 Apr 2026.

Builds on

11 of 20 references.

References · 11

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  4. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  5. 2021On Fast Sampling of Diffusion Probabilistic Modelscited by 170
  6. 2023Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscalingcited by 103
  7. 2020Stochastic Super-Resolution for Downscaling Time-Evolving Atmospheric Fields with a Generative Adversarial Networkcited by 68
  8. 2023DiffCast: A Unified Framework via Residual Diffusion for Precipitation Nowcastingcited by 57
  9. 2020Video Super Resolution Based on Deep Learning: A Comprehensive Surveycited by 54
  10. 2024Can AI be enabled to dynamical downscaling? A Latent Diffusion Model to mimic km-scale COSMO5.0CLM9 simulationscited by 14
  11. 2024Global spatio-temporal downscaling of ERA5 precipitation through generative AIcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Accelerating Diffusion-based Super-Resolution with Dynamic Time-Spatial Sampling
  2. 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolution
  3. 2023Precipitation Downscaling with Spatiotemporal Video Diffusion
  4. 2024Learning Spatial Adaptation and Temporal Coherence in Diffusion Models for Video Super-Resolution
  5. 2026InfScene-SR: Seamless Super-Resolution of Arbitrarily Large Remote-Sensing Scenes via Variance-Preserving Joint Denoising
  6. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution
  7. 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusion
  8. 2024You Only Need One Step: Fast Super-Resolution with Stable Diffusion via Scale Distillation