mlsanityData to 14 Oct 2026

ReTiDe: Real-Time Denoising for Energy-Efficient Motion Picture Processing with FPGAs

arXiv 2510.03812 ↗First posted 4 Oct 2025eess.IV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Denoising is a core operation in modern video pipelines. In codecs, in-loop filters suppress sensor noise and quantisation artefacts to improve rate-distortion performance; in cinema post-production, denoisers are used for restoration, grain management, and plate clean-up. However, state-of-the-art deep denoisers are computationally intensive and, at scale, are typically deployed on GPUs, incurring high power and cost for real-time, high-resolution streams. This paper presents Real-Time Denoise (ReTiDe), a hardware-accelerated denoising system that serves inference on data-centre Field Programmable Gate Arrays (FPGAs). A compact convolutional model is quantised (post-training quantisation plus quantisation-aware fine-tuning) to INT8 and compiled for AMD Deep Learning Processor Unit (DPU)-based FPGAs. A client-server integration offloads computation from the host CPU/GPU to a networked FPGA service, while remaining callable from existing workflows, e.g., NUKE, without disrupting artist tooling. On representative benchmarks, ReTiDe delivers 37.71× Giga Operations Per Second (GOPS) throughput and 5.29× higher energy efficiency than prior FPGA denoising accelerators, with negligible degradation in Peak Signal-to-Noise Ratio (PSNR)/Structural Similarity Index (SSIM). These results indicate that specialised accelerators can provide practical, scalable denoising for both encoding pipelines and post-production, reducing energy per frame without sacrificing quality or workflow compatibility. Code is available at https://github.com/RCSL-TCD/ReTiDe.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 61 references that are in the map. First posted on arXiv 4 Oct 2025.

Builds on

16 of 61 references.

References · 16

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
  5. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  6. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  7. 2021Transformers in Vision: A Surveycited by 1,013
  8. 2021Multi-Stage Progressive Image Restorationcited by 816
  9. 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 510
  10. 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 412
  11. 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 408
  12. 2018Multi-level Wavelet-CNN for Image Restorationcited by 184
4 more
  1. 2020Multi-wavelet residual dense convolutional neural network for image denoisingcited by 3
  2. 2024Lightweight Video Denoising Using a Classic Bayesian Backbonecited by 2
  3. 2024Personalized Generative Low-light Image Denoising and Enhancementcited by 1
  4. 2025Higher fidelity perceptual image and video compression with a latent conditioned residual denoising diffusion modelcited by 1

Built on by

Not cited yet.