mlsanityData to 7 Oct 2026

Lucas-Kanade Reloaded: End-to-End Super-Resolution from Raw Image Bursts

arXiv 2104.06191 ↗First posted 13 Apr 2021cs.CV eess.IVcited by 21

Not on the map. Why?

Abstract (arXiv)

This presentation addresses the problem of reconstructing a high-resolution image from multiple lower-resolution snapshots captured from slightly different viewpoints in space and time. Key challenges for solving this problem include (i) aligning the input pictures with sub-pixel accuracy, (ii) handling raw (noisy) images for maximal faithfulness to native camera data, and (iii) designing/learning an image prior (regularizer) well suited to the task. We address these three challenges with a hybrid algorithm building on the insight from Wronski et al. that aliasing is an ally in this setting, with parameters that can be learned end to end, while retaining the interpretability of classical approaches to inverse problems. The effectiveness of our approach is demonstrated on synthetic and real image bursts, setting a new state of the art on several benchmarks and delivering excellent qualitative results on real raw bursts captured by smartphones and prosumer cameras.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 23 of its 51 references that are in the map. First posted on arXiv 13 Apr 2021.

Builds on

23 of 51 references.

References · 23

  1. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  2. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  3. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  4. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  5. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  6. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
  7. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 492
  8. 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
  9. 2020Deep Unfolding Network for Image Super-Resolutioncited by 253
  10. 2018Unprocessing Images for Learned Raw Denoisingcited by 250
  11. 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 244
  12. 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
11 more
  1. 2020Replacing Mobile Camera ISP with a Single Deep Learning Modelcited by 108
  2. 2020MuCAN: Multi-Correspondence Aggregation Network for Video Super-Resolutioncited by 89
  3. 2019Handheld Multi-Frame Super-Resolutioncited by 85
  4. 2018Theoretical Linear Convergence of Unfolded ISTA and its Practical Weights and Thresholdscited by 83
  5. 2020NTIRE 2020 Challenge on Real-World Image Super-Resolution: Methods and Resultscited by 83
  6. 2021Deep Burst Super-Resolutioncited by 83
  7. 2019Basis Prediction Networks for Effective Burst Denoising with Large Kernelscited by 46
  8. 2020HighRes-net: Recursive Fusion for Multi-Frame Super-Resolution of Satellite Imagerycited by 42
  9. 2019DeepSUM: Deep neural network for Super-resolution of Unregistered Multitemporal imagescited by 30
  10. 2018Multi-Frame Super-Resolution Reconstruction with Applications to Medical Imagingcited by 2
  11. 2016Confidence-aware Levenberg-Marquardt optimization for joint motion estimation and super-resolutioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 7; 2023: 5; 2024: 4; 2025: 1; 2026: 2.

21 papers.

Sort:

By area:

  1. 2021Burst Image Restoration and Enhancementcited by 64
  2. 2022BSRT: Improving Burst Super-Resolution with Swin Transformer and Flow-Guided Deformable Alignmentcited by 32
  3. 2023Burstormer: Burst Image Restoration and Enhancement Transformercited by 32
  4. 2024QMambaBSR: Burst Image Super-Resolution with Query State Space Modelcited by 27
  5. 2022High Dynamic Range and Super-Resolution from Raw Image Burstscited by 18
  6. 2023Gated Multi-Resolution Transfer Network for Burst Restoration and Enhancementcited by 11
  7. 2022Self-Supervised Super-Resolution for Multi-Exposure Push-Frame Satellitescited by 8
  8. 2023Dual-Camera Joint Deblurring-Denoisingcited by 6
  9. 2021Kernel-aware Burst Blind Super-Resolutioncited by 5
  10. 2023RBSR: Efficient and Flexible Recurrent Network for Burst Super-Resolutioncited by 5
  11. 2022Training Adaptive Reconstruction Networks for Blind Inverse Problemscited by 3
  12. 2024A Modular Conditional Diffusion Framework for Image Reconstructioncited by 2
9 more
  1. 2025Efficient RAW Image Deblurring with Adaptive Frequency Modulationcited by 2
  2. 2024Deep 3D World Models for Multi-Image Super-Resolution Beyond Optical Flowcited by 1
  3. 2024Burst Image Super-Resolution with Base Frame Selectioncited by 1
  4. 2022DSR: Towards Drone Image Super-Resolutioncited by 0
  5. 2022Towards Robust Drone Vision in the Wildcited by 0
  6. 2022Cross-Resolution Flow Propagation for Foveated Video Super-Resolutioncited by 0
  7. 2023Fine Dense Alignment of Image Bursts through Camera Pose and Depth Estimationcited by 0
  8. 2026Enhanced Self-Supervised Multi-Image Super-Resolution for Camera Array Imagescited by 0
  9. 2026MatRes: Zero-Shot Test-Time Model Adaptation for Simultaneous Matching and Restorationcited by 0