mlsanityData to 14 Oct 2026

DiTVR: Zero-Shot Diffusion Transformer for Video Restoration

arXiv 2508.07811 ↗First posted 11 Aug 2025cs.CVcited by 4

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Video restoration aims to reconstruct high quality video sequences from low quality inputs, addressing tasks such as super resolution, denoising, and deblurring. Traditional regression based methods often produce unrealistic details and require extensive paired datasets, while recent generative diffusion models face challenges in ensuring temporal consistency. We introduce DiTVR, a zero shot video restoration framework that couples a diffusion transformer with trajectory aware attention and a wavelet guided, flow consistent sampler. Unlike prior 3D convolutional or frame wise diffusion approaches, our attention mechanism aligns tokens along optical flow trajectories, with particular emphasis on vital layers that exhibit the highest sensitivity to temporal dynamics. A spatiotemporal neighbour cache dynamically selects relevant tokens based on motion correspondences across frames. The flow guided sampler injects data consistency only into low-frequency bands, preserving high frequency priors while accelerating convergence. DiTVR establishes a new zero shot state of the art on video restoration benchmarks, demonstrating superior temporal consistency and detail preservation while remaining robust to flow noise and occlusions.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 29 of its 46 references that are in the map. First posted on arXiv 11 Aug 2025.

Builds on

29 of 46 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024Zero-Shot Video Restoration and Enhancement Using Pre-Trained Image Diffusion Model2 Jul
  2. 2024DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Models1 Jul
  3. 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior29 Aug
  4. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization28 Aug
  5. 2023Generative Diffusion Prior for Unified Image Restoration and Enhancement3 Apr
  6. 2023Implicit Diffusion Models for Continuous Super-Resolution29 Mar
  7. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model1 Dec

Other references · 22

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  6. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  7. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  8. 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
  9. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
  10. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  11. 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
  12. 2018Learning Blind Video Temporal Consistencycited by 253
10 more
  1. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
  2. 2016Real-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensationcited by 156
  3. 2017Detail-revealing Deep Video Super-resolutioncited by 148
  4. 2024Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformerscited by 118
  5. 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 113
  6. 2019Spatio-Temporal Filter Adaptive Network for Video Deblurringcited by 106
  7. 2022A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shiftcited by 68
  8. 2018Adversarial Spatio-Temporal Learning for Video Deblurringcited by 60
  9. 2018Generative Adversarial Networks and Perceptual Losses for Video Super-Resolutioncited by 30
  10. 2024FMA-Net: Flow-Guided Dynamic Filtering and Iterative Feature Refinement with Multi-Attention for Joint Video Super-Resolution and Deblurringcited by 28

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025DiffVSR: Revealing an Effective Recipe for Taming Robust Video Super-Resolution Against Complex Degradations
  2. 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restoration
  3. 2026D2-VR: Degradation-Robust and Distilled Video Restoration with Synergistic Optimization Strategy
  4. 2024AsymRnR: Video Diffusion Transformers Acceleration with Asymmetric Reduction and Restoration
  5. 2025TDM: Temporally-Consistent Diffusion Model for All-in-One Real-World Video Restoration
  6. 2026Zero-Shot Video Restoration and Enhancement with Text-to-Image Latent Diffusion Models and Multi-Modal References
  7. 2025CreativeVR: Diffusion-Prior-Guided Approach for Structure and Motion Restoration in Generative and Real Videos
  8. 2025LVTINO: LAtent Video consisTency INverse sOlver for High Definition Video Restoration