ReTiDe: Real-Time Denoising for Energy-Efficient Motion Picture Processing with FPGAs
Not on the map. Why?
Abstract (arXiv)
Denoising is a core operation in modern video pipelines. In codecs, in-loop filters suppress sensor noise and quantisation artefacts to improve rate-distortion performance; in cinema post-production, denoisers are used for restoration, grain management, and plate clean-up. However, state-of-the-art deep denoisers are computationally intensive and, at scale, are typically deployed on GPUs, incurring high power and cost for real-time, high-resolution streams. This paper presents Real-Time Denoise (ReTiDe), a hardware-accelerated denoising system that serves inference on data-centre Field Programmable Gate Arrays (FPGAs). A compact convolutional model is quantised (post-training quantisation plus quantisation-aware fine-tuning) to INT8 and compiled for AMD Deep Learning Processor Unit (DPU)-based FPGAs. A client-server integration offloads computation from the host CPU/GPU to a networked FPGA service, while remaining callable from existing workflows, e.g., NUKE, without disrupting artist tooling. On representative benchmarks, ReTiDe delivers 37.71× Giga Operations Per Second (GOPS) throughput and 5.29× higher energy efficiency than prior FPGA denoising accelerators, with negligible degradation in Peak Signal-to-Noise Ratio (PSNR)/Structural Similarity Index (SSIM). These results indicate that specialised accelerators can provide practical, scalable denoising for both encoding pipelines and post-production, reducing energy per frame without sacrificing quality or workflow compatibility. Code is available at https://github.com/RCSL-TCD/ReTiDe.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 61 references that are in the map. First posted on arXiv 4 Oct 2025.
Builds on
16 of 61 references.
References · 16
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
- 2021Transformers in Vision: A Surveycited by 1,013
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 510
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 412
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 408
- 2018Multi-level Wavelet-CNN for Image Restorationcited by 184
4 more
- 2020Multi-wavelet residual dense convolutional neural network for image denoisingcited by 3
- 2024Lightweight Video Denoising Using a Classic Bayesian Backbonecited by 2
- 2024Personalized Generative Low-light Image Denoising and Enhancementcited by 1
- 2025Higher fidelity perceptual image and video compression with a latent conditioned residual denoising diffusion modelcited by 1
Built on by
Not cited yet.