Invention Grant
- Patent Title: Kernel-predicting convolutional neural networks for denoising
-
Application No.: US16584760Application Date: 2019-09-26
-
Publication No.: US10796414B2Publication Date: 2020-10-06
- Inventor: Thijs Vogels , Jan Novák , Fabrice Rousselle , Brian McWilliams
- Applicant: Disney Enterprises, Inc.
- Applicant Address: US CA Burbank CH Zürich
- Assignee: Disney Enterprises, Inc.,ETH Zürich (Eidgenössische Technische Hochschule Zürich)
- Current Assignee: Disney Enterprises, Inc.,ETH Zürich (Eidgenössische Technische Hochschule Zürich)
- Current Assignee Address: US CA Burbank CH Zürich
- Agency: Kilpatrick Townsend & Stockton LLP
- Main IPC: G06T5/00
- IPC: G06T5/00 ; G06F17/10 ; G06K9/62 ; G06N3/08 ; G06K9/40 ; G06N3/04

Abstract:
Supervised machine learning using convolutional neural network (CNN) is applied to denoising images rendered by MC path tracing. The input image data may include pixel color and its variance, as well as a set of auxiliary buffers that encode scene information (e.g., surface normal, albedo, depth, and their corresponding variances). In some embodiments, a CNN directly predicts the final denoised pixel value as a highly non-linear combination of the input features. In some other embodiments, a kernel-prediction neural network uses a CNN to estimate the local weighting kernels, which are used to compute each denoised pixel from its neighbors. In some embodiments, the input image can be decomposed into diffuse and specular components. The diffuse and specular components are then independently preprocessed, filtered, and postprocessed, before recombining them to obtain a final denoised image.
Public/Granted literature
- US20200027198A1 KERNEL-PREDICTING CONVOLUTIONAL NEURAL NETWORKS FOR DENOISING Public/Granted day:2020-01-23
Information query