Burst Denoising with Kernel Prediction Networks
Not on the map. Why?
Abstract (arXiv)
We present a technique for jointly denoising bursts of images taken from a handheld camera. In particular, we propose a convolutional neural network architecture for predicting spatially varying kernels that can both align and denoise frames, a synthetic data generation approach based on a realistic noise formation model, and an optimization guided by an annealed loss function to avoid undesirable local minima. Our model matches or outperforms the state-of-the-art across a wide range of noise levels on both real and synthetic data.
Key facts. Cited by 157 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 34; 2022: 35; 2023: 41; 2024: 27; 2025: 11; 2026: 9.
157 papers.
Sort:
By area:
- 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
- 2021Invertible Image Signal Processingcited by 94
- 2021LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyondcited by 88
- 2021Iterative Filter Adaptive Network for Single Image Defocus Deblurringcited by 86
- 2023Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --cited by 71
- 2022A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shiftcited by 68
- 2021Physics-based Noise Modeling for Extreme Low-light Photographycited by 67
- 2021Burst Image Restoration and Enhancementcited by 64
- 2021Mobile Computational Photography: A Tourcited by 62
- 2021Rethinking Noise Synthesis and Modeling in Raw Denoisingcited by 62
- 2021Deep Gaussian Scale Mixture Prior for Spectral Compressive Imagingcited by 58
38 more
- 2021Adaptive Unfolding Total Variation Network for Low-Light Image Enhancementcited by 55
- 2022Omni-Dimensional Dynamic Convolutioncited by 55
- 2022NAN: Noise-Aware NeRFs for Burst-Denoisingcited by 48
- 2022Dancing under the stars: video denoising in starlightcited by 47
- 2022Learning for Vehicle-to-Vehicle Cooperative Perception under Lossy Communicationcited by 47
- 2022Learning to Deblur using Light Field Generated and Real Defocus Imagescited by 46
- 2021Deep Reparametrization of Multi-Frame Super-Resolution and Denoisingcited by 39
- 2021DWDN: Deep Wiener Deconvolution Network for Non-Blind Image Deblurringcited by 36
- 2021IDR: Self-Supervised Image Denoising via Iterative Data Refinementcited by 36
- 2024RobustSAM: Segment Anything Robustly on Degraded Imagescited by 36
- 2024Restore-RWKV: Efficient and Effective Medical Image Restoration with RWKVcited by 36
- 2022MISF: Multi-level Interactive Siamese Filtering for High-Fidelity Image Inpaintingcited by 35
- 2022Learning Degradation Representations for Image Deblurringcited by 35
- 2023Aleth-NeRF: Illumination Adaptive NeRF with Concealing Field Assumptioncited by 35
- 2023KBNet: Kernel Basis Network for Image Restorationcited by 33
- 2023Burstormer: Burst Image Restoration and Enhancement Transformercited by 32
- 2021Removing Diffraction Image Artifacts in Under-Display Camera via Dynamic Skip Connection Networkcited by 31
- 2023MM-BSN: Self-Supervised Image Denoising for Real-World with Multi-Mask based on Blind-Spot Networkcited by 30
- 2021Event-guided Deblurring of Unknown Exposure Time Videoscited by 26
- 2023Leveraging Inpainting for Single-Image Shadow Removalcited by 25
- 2022Unidirectional Video Denoising by Mimicking Backward Recurrent Modules with Look-ahead Forward Onescited by 24
- 2023ParamISP: Learned Forward and Inverse ISPs using Camera Parameterscited by 23
- 2024Factorized Diffusion: Perceptual Illusions by Noise Decompositioncited by 23
- 2021NTIRE 2021 Challenge on Burst Super-Resolution: Methods and Resultscited by 22
- 2023A Unified Conditional Framework for Diffusion-based Image Restorationcited by 22
- 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognitioncited by 20
- 2023Towards General Low-Light Raw Noise Synthesis and Modelingcited by 19
- 2025Frequency Dynamic Convolution for Dense Image Predictioncited by 19
- 2021Joint Denoising and Demosaicking with Green Channel Prior for Real-world Burst Imagescited by 18
- 2023S2R-ViT for Multi-Agent Cooperative Perception: Bridging the Gap from Simulation to Realitycited by 18
- 2021JPGNet: Joint Predictive Filtering and Generative Network for Image Inpaintingcited by 17
- 2022Self-Supervised Image Restoration with Blurry and Noisy Pairscited by 17
- 2021Passive Inter-Photon Imagingcited by 16
- 2022Consistent Direct Time-of-Flight Video Depth Super-Resolutioncited by 16
- 2023Neural Spline Fields for Burst Image Fusion and Layer Separationcited by 16
- 2022Efficient Burst Raw Denoising with Variance Stabilization and Multi-frequency Denoising Networkcited by 15
- 2023LLDiffusion: Learning Degradation Representations in Diffusion Models for Low-Light Image Enhancementcited by 15
- 2021GridDehazeNet+: An Enhanced Multi-Scale Network with Intra-Task Knowledge Transfer for Single Image Dehazingcited by 14
50 most cited of 157 All 157 (JSON)
- 2026SteadySplats: Resampling of Low-Variance Gaussians for High-Fidelity Stochastic Rendering4 Oct 2026
- 2026Super-Resolving Unseen Hyperspectral Sensors at Any Scale via Spatial Operators30 Sep 2026
- 2026NTIRE 2026 Low-light Enhancement: Twilight Cowboy Challenge10 Aug 2026
- 2026Bricker to BRACE: A Bracket Exposure RAW Dataset and Restoration Model for Flicker-Banding29 Jun 2026
- 2026Continuous Expert Assembly: Instance-Conditioned Low-Rank Residuals for All-in-One Image Restoration7 May 2026
- 2026It Takes Two: A Duet of Periodicity and Directionality for Burst Flicker Removal24 Mar 2026
- 2026Dark3R: Learning Structure from Motion in the Dark5 Mar 2026
- 2026Denoising the Deep Sky: Physics-Based CCD Noise Formation for Astronomical Imaging30 Jan 2026
- 2026From Physical Degradation Models to Task-Aware All-in-One Image Restoration15 Jan 2026
- 2025DISK: Differentiable Sparse Kernel Complex for Efficient Spatially-Variant Convolution4 Dec 2025
- 2025DenoiseGS: Gaussian Reconstruction Model for Burst Denoising28 Nov 2025
- 2025Burst Image Quality Assessment: A New Benchmark and Unified Framework for Multiple Downstream Tasks11 Nov 2025
38 more
- 2025IDF: Iterative Dynamic Filtering Networks for Generalizable Image Denoising27 Aug 2025
- 2025AIM 2025 Low-light RAW Video Denoising Challenge: Dataset, Methods and Results22 Aug 2025
- 2025FOCUS: Frequency-Optimized Conditioning of DiffUSion Models for mitigating catastrophic forgetting during Test-Time Adaptation20 Aug 2025
- 2025Single-shot HDR using conventional image sensor shutter functions and optical randomization27 Jun 2025
- 2025K-Buffers: A Plug-in Method for Enhancing Neural Fields with Multiple Buffers26 May 2025
- 2025NTIRE 2025 Challenge on Efficient Burst HDR and Restoration: Datasets, Methods, and Results17 May 2025
- 2025Keyframe-Centric State-Space Modeling for Burst Image Super-Resolution25 Mar 2025
- 2025Frequency Dynamic Convolution for Dense Image Prediction24 Mar 2025
- 2024Towards Degradation-Robust Reconstruction in Generalizable NeRF18 Nov 2024
- 2024LBurst: Learning-Based Robotic Burst Feature Extraction for 3D Reconstruction in Low Light31 Oct 2024
- 2024Temporal As a Plugin: Unsupervised Video Denoising with Pre-Trained Image Denoisers17 Sep 2024
- 2024A Practical Gated Recurrent Transformer Network Incorporating Multiple Fusions for Video Denoising10 Sep 2024
- 2024A Learnable Color Correction Matrix for RAW Reconstruction4 Sep 2024
- 2024CMTA: Cross-Modal Temporal Alignment for Event-guided Video Deblurring27 Aug 2024
- 2024Pupil-Adaptive 3D Holography Beyond Coherent Depth-of-Field17 Aug 2024
- 2024Restore-RWKV: Efficient and Effective Medical Image Restoration with RWKV14 Jul 2024
- 2024LeRF: Learning Resampling Function for Adaptive and Efficient Image Interpolation13 Jul 2024
- 2024Radiance Fields from Photons12 Jul 2024
- 2024Technique Report of CVPR 2024 PBDL Challenges15 Jun 2024
- 2024RobustSAM: Segment Anything Robustly on Degraded Images13 Jun 2024
- 2024KernelWarehouse: Rethinking the Design of Dynamic Convolution12 Jun 2024
- 2024LED: A Large-scale Real-world Paired Dataset for Event Camera Denoising30 May 2024
- 2024KPNDepth: Depth Estimation of Lane Images under Complex Rainy Environment16 May 2024
- 2024Investigating Self-Supervised Image Denoising with Denaturation2 May 2024
- 2024Deep RAW Image Super-Resolution. A NTIRE 2024 Challenge Survey24 Apr 2024
- 2024CRNet: A Detail-Preserving Network for Unified Image Restoration and Enhancement Task22 Apr 2024
- 2024Non-Uniform Exposure Imaging via Neuromorphic Shutter Control22 Apr 2024
- 2024Factorized Diffusion: Perceptual Illusions by Noise Decomposition17 Apr 2024
- 2024Event Cameras Meet SPADs for High-Speed, Low-Bandwidth Imaging17 Apr 2024
- 2024Improving Bracket Image Restoration and Enhancement with Flow-guided Alignment and Enhanced Feature Aggregation16 Apr 2024
- 2024NIR-Assisted Image Denoising: A Selective Fusion Approach and A Real-World Benchmark Dataset12 Apr 2024
- 2024RaFE: Generative Radiance Fields Restoration4 Apr 2024
- 2024Powerful Lossy Compression for Noisy Images21 Mar 2024
- 2024Joint End-to-End Image Compression and Denoising: Leveraging Contrastive Learning and Multi-Scale Self-ONNs8 Feb 2024
- 2024Breaking Data Silos: Cross-Domain Learning for Multi-Agent Perception from Independent Private Sources6 Feb 2024
- 2023Toward Accurate and Temporally Consistent Video Restoration from Raw Data25 Dec 2023
- 2023BSRAW: Improving Blind RAW Image Super-Resolution24 Dec 2023
- 2023Neural Spline Fields for Burst Image Fusion and Layer Separation21 Dec 2023
50 newest of 157 All 157 (JSON)
- 2024Factorized Diffusion: Perceptual Illusions by Noise Decompositioncited by 23
- 2023A Unified Conditional Framework for Diffusion-based Image Restorationcited by 22
- 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognitioncited by 20
- 2023LLDiffusion: Learning Degradation Representations in Diffusion Models for Low-Light Image Enhancementcited by 15
- 2023SVNR: Spatially-variant Noise Removal with Denoising Diffusioncited by 8
- 2022Complex-valued Retrievals From Noisy Images Using Diffusion Modelscited by 3
- 2025FOCUS: Frequency-Optimized Conditioning of DiffUSion Models for mitigating catastrophic forgetting during Test-Time Adaptationcited by 0
- 2025FOCUS: Frequency-Optimized Conditioning of DiffUSion Models for mitigating catastrophic forgetting during Test-Time Adaptation20 Aug 2025
- 2024Factorized Diffusion: Perceptual Illusions by Noise Decomposition17 Apr 2024
- 2023LLDiffusion: Learning Degradation Representations in Diffusion Models for Low-Light Image Enhancement27 Jul 2023
- 2023SVNR: Spatially-variant Noise Removal with Denoising Diffusion28 Jun 2023
- 2023A Unified Conditional Framework for Diffusion-based Image Restoration31 May 2023
- 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition7 Mar 2023
- 2022Complex-valued Retrievals From Noisy Images Using Diffusion Models6 Dec 2022
- 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
- 2021Invertible Image Signal Processingcited by 94
- 2021LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyondcited by 88
- 2021Iterative Filter Adaptive Network for Single Image Defocus Deblurringcited by 86
- 2023Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --cited by 71
- 2022A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shiftcited by 68
- 2021Physics-based Noise Modeling for Extreme Low-light Photographycited by 67
- 2021Burst Image Restoration and Enhancementcited by 64
- 2021Mobile Computational Photography: A Tourcited by 62
- 2021Rethinking Noise Synthesis and Modeling in Raw Denoisingcited by 62
- 2021Deep Gaussian Scale Mixture Prior for Spectral Compressive Imagingcited by 58
12 most cited of 150 All 150 (JSON)
- 2026SteadySplats: Resampling of Low-Variance Gaussians for High-Fidelity Stochastic Rendering4 Oct 2026
- 2026Super-Resolving Unseen Hyperspectral Sensors at Any Scale via Spatial Operators30 Sep 2026
- 2026NTIRE 2026 Low-light Enhancement: Twilight Cowboy Challenge10 Aug 2026
- 2026Bricker to BRACE: A Bracket Exposure RAW Dataset and Restoration Model for Flicker-Banding29 Jun 2026
- 2026Continuous Expert Assembly: Instance-Conditioned Low-Rank Residuals for All-in-One Image Restoration7 May 2026
- 2026It Takes Two: A Duet of Periodicity and Directionality for Burst Flicker Removal24 Mar 2026
- 2026Dark3R: Learning Structure from Motion in the Dark5 Mar 2026
- 2026Denoising the Deep Sky: Physics-Based CCD Noise Formation for Astronomical Imaging30 Jan 2026
- 2026From Physical Degradation Models to Task-Aware All-in-One Image Restoration15 Jan 2026
- 2025DISK: Differentiable Sparse Kernel Complex for Efficient Spatially-Variant Convolution4 Dec 2025
- 2025DenoiseGS: Gaussian Reconstruction Model for Burst Denoising28 Nov 2025
- 2025Burst Image Quality Assessment: A New Benchmark and Unified Framework for Multiple Downstream Tasks11 Nov 2025
12 newest of 150 All 150 (JSON)