Invention Grant
- Patent Title: Animating avatars from headset cameras
-
Application No.: US16449117Application Date: 2019-06-21
-
Publication No.: US10885693B1Publication Date: 2021-01-05
- Inventor: Jason Saragih , Shih-En Wei
- Applicant: Facebook Technologies, LLC
- Applicant Address: US CA Menlo Park
- Assignee: Facebook Technologies, LLC
- Current Assignee: Facebook Technologies, LLC
- Current Assignee Address: US CA Menlo Park
- Agency: Baker Botts L.L.P.
- Main IPC: G06T13/40
- IPC: G06T13/40 ; G06T7/00 ; G06T7/70 ; G06T1/20 ; H04N5/247

Abstract:
In one embodiment, a computing system may access a plurality of first captured images that are captured in a first spectral domain, generate, using a first machine-learning model, a plurality of first domain-transferred images based on the first captured images, wherein the first domain-transferred images are in a second spectral domain, render, based on a first avatar, a plurality of first rendered images comprising views of the first avatar, and update the first machine-learning model based on comparisons between the first domain-transferred images and the first rendered images, wherein the first machine-learning model is configured to translate images in the first spectral domain to the second spectral domain. The system may also generate, using a second machine-learning model, the first avatar based on the first captured images. The first avatar may be rendered using a parametric face model based on a plurality of avatar parameters.
Information query