Spectral Monte Carlo Denoiser - Université de Reims Champagne-Ardenne
Conference Poster Year : 2024

Spectral Monte Carlo Denoiser

Abstract

Spectral rendering approaches are nowadays the most accurate ones for predictively simulating the light transport equation with advanced wavelength-dependent phenomena such as light dispersion or metamerism. However, these approaches require a much larger number of samples and longer computational times than standard trichromatic ones\textemdash e.g. expressed in RGB color spaces\textemdash to properly sample the visible spectral/spectrum domain and achieve noise-free images. To address these issues, denoising solutions can be applied to a spectral renderer in order to remove potential color noise, while ensuring that the reconstruction can properly conserve wavelength-dependant phenomena. Inspired from a feature fusion based deep dual-encoder network, we propose a deep-learning approach applied to multi-spectral images. Instead of denoising already-integrated RGB data, and to preserve crucial spectral information, we discretize the output of a spectral renderer into multiple spectral bins. As a way for our architecture to remain agnostic in regard to the number of bins, we denoise each bin independently and use a PCA-like batch normalization transformation, also known as whitening tranformation, to compress all spectral bins into a single parametric image. This parametric feature used as an auxiliary input allows us to conserve critical context information when denoising each bin. In addition to other auxiliary features such as normal and depth, we provide the denoiser with a spectral albedo discretized in the same manner as the noisy input. Our experiments demonstrate that our method outperforms state-of-the-art denoising techniques for spectral rendering while significantly reducing the number of samples required for noise-free images, and provides a better reconstruction than trichromatic regular approaches, preventing the appearance of most artefacts.
Fichier principal
Vignette du fichier
HPG24-paper39-poster-Spectral Monte Carlo Denoiser.pdf (379.19 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04716800 , version 1 (01-10-2024)

Identifiers

  • HAL Id : hal-04716800 , version 1

Cite

Mathieu Noizet, Robin Rouphael, Stéphanie Prévost, Hervé Deleau, Luiz Angelo Steffenel, et al.. Spectral Monte Carlo Denoiser. High-Performance Graphics 2024, Jul 2024, Denver (Colorado, USA), United States. ⟨hal-04716800⟩

Collections

URCA ANR LICIIS
0 View
0 Download

Share

More