公开(公告)号：US20240290021A1

公开(公告)日：2024-08-29

申请号：US18114975

申请日：2023-02-27

Applicant: Fujitsu Limited

Inventor： Heng YU ,  Joel JULIN ,  Zoltán Ádám MILACSKI ,  Koichiro NIINUMA ,  Laszlo JENI

IPC: G06T13/40 ,  G06T3/40 ,  G06T15/06

CPC classification number: G06T13/40 ,  G06T3/4046 ,  G06T15/06

Abstract: In an example, a method may include deforming a first ray associated with a dynamic object at a first time using a first neural network and a latent code to obtain a deformed ray. The method may also include obtaining a hyperspace code associated with the first ray by inputting the first ray, the first time, and the latent code into a second neural network. The method may further include sampling one or more points from the deformed ray. The method may also include combining the sampled points and the hyperspace code into a network input. The method may further include inputting the network input into a third neural network to obtain RGB values for rendering images of a three-dimensional scene representative of the dynamic object at a second time.

公开(公告)号：US20240161376A1

公开(公告)日：2024-05-16

申请号：US18192607

申请日：2023-03-29

Applicant: Fujitsu Limited

Inventor： Heng YU ,  Koichiro NIINUMA ,  Laszlo JENI

IPC: G06T13/40 ,  G06T17/00 ,  G06V40/16

CPC classification number: G06T13/40 ,  G06T17/00 ,  G06V40/168

Abstract: In an example, a method may include obtaining, from a data source, first data including multiple frames each including a human face. The method may include automatically detecting, in each of the multiple frames, one or more facial landmarks and one or more action units (AUs) associated with the human face. The method may also include automatically generating one or more semantic masks based at least on the one or more facial landmarks, the one or more semantic masks individually corresponding to the human face. The method may further include obtaining a facial hyperspace using at least the first data, the one or more AUs, and the semantic masks. The method may also include generating a synthetic image of the human face using a first frame of the multiple frames and one or more AU intensities individually associated with the one or more AUs.