ReTiDe: Real-Time Denoising for Energy-Efficient Motion Picture Processing with FPGAs
Li, Changhong, Bled, Clément, Fernandez, Rosa, Shanker, Shreejith
–arXiv.org Artificial Intelligence
Denoising is a core operation in modern video pipelines. In codecs, in-loop filters suppress sensor noise and quantisation artefacts to improve rate-distortion performance; in cinema post-production, denoisers are used for restoration, grain management, and plate clean-up. However, state-of-the-art deep denoisers are computationally intensive and, at scale, are typically deployed on GPUs, incurring high power and cost for real-time, high-resolution streams. This paper presents Real-Time Denoise (ReTiDe), a hardware-accelerated denoising system that serves inference on data-centre Field Programmable Gate Arrays (FPGAs). A compact convolutional model is quantised (post-training quantisation plus quantisation-aware fine-tuning) to INT8 and compiled for AMD Deep Learning Processor Unit (DPU)-based FPGAs. A client-server integration offloads computation from the host CPU/GPU to a networked FPGA service, while remaining callable from existing workflows, e.g., NUKE, without disrupting artist tooling. On representative benchmarks, ReTiDe delivers 37.71$\times$ Giga Operations Per Second (GOPS) throughput and 5.29$\times$ higher energy efficiency than prior FPGA denoising accelerators, with negligible degradation in Peak Signal-to-Noise Ratio (PSNR)/Structural Similarity Index (SSIM). These results indicate that specialised accelerators can provide practical, scalable denoising for both encoding pipelines and post-production, reducing energy per frame without sacrificing quality or workflow compatibility. Code is available at https://github.com/RCSL-TCD/ReTiDe.
arXiv.org Artificial Intelligence
Oct-7-2025
- Country:
- Europe
- France (0.04)
- Ireland > Leinster
- County Dublin > Dublin (0.14)
- Switzerland (0.04)
- United Kingdom > England
- Greater London > London (0.05)
- North America > United States
- New York > New York County > New York City (0.04)
- Europe
- Genre:
- Research Report (1.00)
- Industry:
- Information Technology > Services (0.34)
- Media > Film (0.41)
- Semiconductors & Electronics (0.68)
- Technology:
- Information Technology
- Architecture > Real Time Systems (0.92)
- Artificial Intelligence
- Machine Learning > Neural Networks
- Deep Learning (1.00)
- Vision (1.00)
- Machine Learning > Neural Networks
- Communications (1.00)
- Hardware (1.00)
- Sensing and Signal Processing > Image Processing (1.00)
- Information Technology