Invention Grant
- Patent Title: Reconstructing three-dimensional scenes using multi-view cycle projection
-
Application No.: US16816080Application Date: 2020-03-11
-
Publication No.: US10937237B1Publication Date: 2021-03-02
- Inventor: Vladimir Kim , Pierre-alain Langlois , Matthew Fisher , Bryan Russell , Oliver Wang
- Applicant: Adobe Inc.
- Applicant Address: US CA San Jose
- Assignee: Adobe Inc.
- Current Assignee: Adobe Inc.
- Current Assignee Address: US CA San Jose
- Agency: Keller Jolley Preece
- Main IPC: G06T17/20
- IPC: G06T17/20 ; G06T7/73 ; G06T7/77 ; G06T19/20 ; G06N3/04

Abstract:
Methods, systems, and non-transitory computer readable storage media are disclosed for reconstructing three-dimensional object meshes from two-dimensional images of objects using multi-view cycle projection. For example, the disclosed system can determine a multi-view cycle projection loss across a plurality of images of an object via an estimated three-dimensional object mesh of the object. For example, the disclosed system uses a pixel mapping neural network to project a sampled pixel location across a plurality of images of an object and via a three-dimensional mesh representing the object. The disclosed system determines a multi-view cycle consistency loss based on a difference between the sampled pixel location and a cycle projection of the sampled pixel location and uses the loss to update the pixel mapping neural network, a latent vector representing the object, or a shape generation neural network that uses the latent vector to generate the object mesh.
Information query