Invention Grant
- Patent Title: Deferred neural rendering for view extrapolation
-
Application No.: US17516136Application Date: 2021-11-01
-
Publication No.: US11887256B2Publication Date: 2024-01-30
- Inventor: Tobias Bertel , Yusuke Tomoto , Srinivas Rao , Krunal Ketan Chande , Rodrigo Ortiz-Cayon , Stefan Johannes Josef Holzer , Christian Richardt
- Applicant: Fyusion, Inc.
- Applicant Address: US CA San Francisco
- Assignee: Fyusion, Inc.
- Current Assignee: Fyusion, Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Kwan & Olynick LLP
- Main IPC: G06T17/20
- IPC: G06T17/20 ; G06T15/04 ; G06V10/75 ; G06F18/21 ; G06N3/045

Abstract:
Novel images may be generated using an image generator implemented on a processor. The image generator may receive as input neural features selected from a neural texture atlas. The image generator may also receive as input one or more position guides identifying position information for a plurality of input image pixels. The novel images may be evaluated using an image discriminator to determine a plurality of optimization values by comparing each of the plurality of novel images with a respective one of a corresponding plurality of input images. Each of the novel images may be generated from a respective camera pose relative to an object identical to that of the respective one of the corresponding plurality of input images. The image generator and the neural features may be updated based on the optimization values and stored on a storage device.
Public/Granted literature
- US20220139036A1 DEFERRED NEURAL RENDERING FOR VIEW EXTRAPOLATION Public/Granted day:2022-05-05
Information query