VIDEO SYNTHESIS WITHIN A MESSAGING SYSTEM
    1.
    发明申请

    公开(公告)号:WO2022072725A1

    公开(公告)日:2022-04-07

    申请号:PCT/US2021/053012

    申请日:2021-09-30

    Applicant: SNAP INC.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for video synthesis. The program and method provide for accessing a primary generative adversarial network (GAN) comprising a pre-trained image generator, a motion generator comprising a plurality of neural networks, and a video discriminator; generating an updated GAN based on the primary GAN, by performing operations comprising identifying input data of the updated GAN, the input data comprising an initial latent code and a motion domain dataset, training the motion generator based on the input data, and adjusting weights of the plurality of neural networks of the primary GAN based on an output of the video discriminator; and generating a synthesized video based on the primary GAN and the input data.

    FLOW-GUIDED MOTION RETARGETING
    2.
    发明申请

    公开(公告)号:WO2022146772A1

    公开(公告)日:2022-07-07

    申请号:PCT/US2021/064531

    申请日:2021-12-21

    Applicant: SNAP INC.

    Abstract: Systems and methods herein describe a motion retargeting system. The motion retargeting system accesses a plurality of two-dimensional images comprising a person performing a plurality of body poses, extracts a plurality of implicit volumetric representations from the plurality of body poses, generates a three-dimensional warping field, the three-dimensional warping field configured to warp the plurality of implicit volumetric representations from a canonical pose to a target pose, and based on the three-dimensional warping field, generates a two-dimensional image of an artificial person performing the target pose.

Patent Agency Ranking