# Spatio-Temporal Deformable Attention Network for Video Deblurring

arXiv: https://arxiv.org/abs/2207.10852 · HTML: https://mlsanity.com/paper/2207.10852/

## Key facts

- Cited by 21 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 45 references that are in the map.
- First posted on arXiv 22 Jul 2022.

## Builds on (most cited first, 22 of 22)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [Deformable DETR: Deformable Transformers for End-to-End Object Detection](https://mlsanity.com/paper/2010.04159/) (2020)
- [FlowNet: Learning Optical Flow with Convolutional Networks](https://mlsanity.com/paper/1504.06852/) (2015)
- [PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume](https://mlsanity.com/paper/1709.02371/) (2017)
- [Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring](https://mlsanity.com/paper/1612.02177/) (2016)
- [EDVR: Video Restoration with Enhanced Deformable Convolutional Networks](https://mlsanity.com/paper/1905.02716/) (2019)
- [DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Better](https://mlsanity.com/paper/1908.03826/) (2019)
- [Scale-recurrent Network for Deep Image Deblurring](https://mlsanity.com/paper/1802.01770/) (2018)
- [Deep Stacked Hierarchical Multi-patch Network for Image Deblurring](https://mlsanity.com/paper/1904.03468/) (2019)
- [Learning a Convolutional Neural Network for Non-uniform Motion Blur Removal](https://mlsanity.com/paper/1503.00593/) (2015)
- [Multi-Temporal Recurrent Neural Networks For Progressive Non-Uniform Single Image Deblurring With Incremental Temporal Training](https://mlsanity.com/paper/1911.07410/) (2019)
- [Spatio-Temporal Filter Adaptive Network for Video Deblurring](https://mlsanity.com/paper/1904.12257/) (2019)
- [Cascaded Deep Video Deblurring Using Temporal Sharpness Prior](https://mlsanity.com/paper/2004.02501/) (2020)
- [From Motion Blur to Motion Flow: a Deep Learning Solution for Removing Heterogeneous Motion Blur](https://mlsanity.com/paper/1612.02583/) (2016)
- [Accurate Optical Flow via Direct Cost Volume Processing](https://mlsanity.com/paper/1704.07325/) (2017)
- [Adversarial Spatio-Temporal Learning for Video Deblurring](https://mlsanity.com/paper/1804.00533/) (2018)
- [ARVo: Learning All-Range Volumetric Correspondence for Video Deblurring](https://mlsanity.com/paper/2103.04260/) (2021)
- [Online Video Deblurring via Dynamic Temporal Blending Network](https://mlsanity.com/paper/1704.03285/) (2017)
- [Recurrent Video Deblurring with Blur-Invariant Motion Estimation and Pixel Volumes](https://mlsanity.com/paper/2108.09982/) (2021)
- [Generalized Video Deblurring for Dynamic Scenes](https://mlsanity.com/paper/1507.02438/) (2015)
- [Learning Blind Motion Deblurring](https://mlsanity.com/paper/1708.04208/) (2017)

## Built on by (most cited first, 21 of 21)

- [DyBluRF: Dynamic Neural Radiance Fields from Blurry Monocular Video](https://mlsanity.com/paper/2403.10103/) (2024)
- [Blur-aware Spatio-temporal Sparse Transformer for Video Deblurring](https://mlsanity.com/paper/2406.07551/) (2024)
- [Learning Truncated Causal History Model for Video Restoration](https://mlsanity.com/paper/2410.03936/) (2024)
- [MoBluRF: Motion Deblurring Neural Radiance Fields for Blurry Monocular Video](https://mlsanity.com/paper/2312.13528/) (2023)
- [CMTA: Cross-Modal Temporal Alignment for Event-guided Video Deblurring](https://mlsanity.com/paper/2408.14930/) (2024)
- [Driving-Video Dehazing with Non-Aligned Regularization for Safety Assistance](https://mlsanity.com/paper/2405.09996/) (2024)
- [Domain-adaptive Video Deblurring via Test-time Blurring](https://mlsanity.com/paper/2407.09059/) (2024)
- [EDCFlow: Exploring Temporally Dense Difference Maps for Event-based Optical Flow Estimation](https://mlsanity.com/paper/2506.03512/) (2025)
- [Learning to Deblur Polarized Images](https://mlsanity.com/paper/2402.18134/) (2024)
- [DAVIDE: Depth-Aware Video Deblurring](https://mlsanity.com/paper/2409.01274/) (2024)
- [Deblur-Avatar: Animatable Avatars from Motion-Blurred Monocular Videos](https://mlsanity.com/paper/2501.13335/) (2025)
- [Coding-Prior Guided Diffusion Network for Video Deblurring](https://mlsanity.com/paper/2504.12222/) (2025)
- [EgoVSR: Towards High-Quality Egocentric Video Super-Resolution](https://mlsanity.com/paper/2305.14708/) (2023)
- [From Contrast to Consistency: Rethinking Event-based Continuous-Time Optical Flow Estimation](https://mlsanity.com/paper/2605.25570/) (2026)
- [Three-Stage Cascade Framework for Blurry Video Frame Interpolation](https://mlsanity.com/paper/2310.05383/) (2023)
- [ViStripformer: A Token-Efficient Transformer for Versatile Video Restoration](https://mlsanity.com/paper/2312.14502/) (2023)
- [Retrieval Robust to Object Motion Blur](https://mlsanity.com/paper/2404.18025/) (2024)
- [Adaptive High-Pass Kernel Prediction for Efficient Video Deblurring](https://mlsanity.com/paper/2412.01559/) (2024)
- [SelfHVD: Self-Supervised Handheld Video Deblurring](https://mlsanity.com/paper/2508.08605/) (2025)
- [FMA-Net++: Motion- and Exposure-Aware Joint Video Super-Resolution and Deblurring](https://mlsanity.com/paper/2512.04390/) (2025)
- [UAV Video Deblurring via Motion-Aware Diffusion: A Path to Robust Target Detection](https://mlsanity.com/paper/2608.15259/) (2026)

## Abstract (arXiv)

The key success factor of the video deblurring methods is to compensate for the blurry pixels of the mid-frame with the sharp pixels of the adjacent video frames. Therefore, mainstream methods align the adjacent frames based on the estimated optical flows and fuse the alignment frames for restoration. However, these methods sometimes generate unsatisfactory results because they rarely consider the blur levels of pixels, which may introduce blurry pixels from video frames. Actually, not all the pixels in the video frames are sharp and beneficial for deblurring. To address this problem, we propose the spatio-temporal deformable attention network (STDANet) for video delurring, which extracts the information of sharp pixels by considering the pixel-wise blur levels of the video frames. Specifically, STDANet is an encoder-decoder network combined with the motion estimator and spatio-temporal deformable attention (STDA) module, where motion estimator predicts coarse optical flows that are used as base offsets to find the corresponding sharp pixels in STDA module. Experimental results indicate that the proposed STDANet performs favorably against state-of-the-art methods on the GoPro, DVD, and BSD datasets.