Invention Grant
- Patent Title: Systems and methods for rendering avatars with deep appearance models
-
Application No.: US16049848Application Date: 2018-07-31
-
Publication No.: US10586370B2Publication Date: 2020-03-10
- Inventor: Stephen Anthony Lombardi , Jason Saragih , Yaser Sheikh , Takaaki Shiratori , Shoou-I Yu , Tomas Simon Kreuz , Chenglei Wu
- Applicant: Oculus VR, LLC
- Applicant Address: US CA Menlo Park
- Assignee: Facebook Technologies, LLC
- Current Assignee: Facebook Technologies, LLC
- Current Assignee Address: US CA Menlo Park
- Agency: FisherBroyles, LLP
- Main IPC: G06T13/40
- IPC: G06T13/40 ; G06T15/04 ; G06T15/20 ; G06T17/20 ; G06T15/06 ; G06T19/00

Abstract:
The disclosed computer system may include an input module, an autoencoder, and a rendering module. The input module may receive geometry information and images of a subject. The geometry information may be indicative of variation in geometry of the subject over time. Each image may be associated with a respective viewpoint and may include a view-dependent texture map of the subject. The autoencoder may jointly encode texture information and the geometry information to provide a latent vector. The autoencoder may infer, using the latent vector, an inferred geometry and an inferred view-dependent texture of the subject for a predicted viewpoint. The rendering module may be configured to render a reconstructed image of the subject for the predicted viewpoint using the inferred geometry and the inferred view-dependent texture. Various other systems and methods are also disclosed.
Public/Granted literature
- US20190213772A1 SYSTEMS AND METHODS FOR RENDERING AVATARS WITH DEEP APPEARANCE MODELS Public/Granted day:2019-07-11
Information query