PHOTOMETRIC-BASED 3D OBJECT MODELING
    1.
    发明申请

    公开(公告)号:WO2021222386A1

    公开(公告)日:2021-11-04

    申请号:PCT/US2021/029609

    申请日:2021-04-28

    Applicant: SNAP INC.

    Inventor: WOODFORD, Oliver

    Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: accessing a source image depicting a target structure; accessing one or more target images depicting at least a portion of the target structure; computing correspondence between a first set of pixels in the source image of a first portion of the target structure and a second set of pixels in the one or more target images of the first portion of the target structure, the correspondence being computed as a function of camera parameters that vary between the source image and the one or more target images; and generating a three-dimensional (3D) model of the target structure based on the correspondence between the first set of pixels in the source image and the second set of pixels in the one or more target images based on a joint optimization of target structure and camera parameters.

    FLOW-GUIDED MOTION RETARGETING
    3.
    发明申请

    公开(公告)号:WO2022146772A1

    公开(公告)日:2022-07-07

    申请号:PCT/US2021/064531

    申请日:2021-12-21

    Applicant: SNAP INC.

    Abstract: Systems and methods herein describe a motion retargeting system. The motion retargeting system accesses a plurality of two-dimensional images comprising a person performing a plurality of body poses, extracts a plurality of implicit volumetric representations from the plurality of body poses, generates a three-dimensional warping field, the three-dimensional warping field configured to warp the plurality of implicit volumetric representations from a canonical pose to a target pose, and based on the three-dimensional warping field, generates a two-dimensional image of an artificial person performing the target pose.

    MOTION REPRESENTATIONS FOR ARTICULATED ANIMATION

    公开(公告)号:WO2022006299A1

    公开(公告)日:2022-01-06

    申请号:PCT/US2021/039935

    申请日:2021-06-30

    Applicant: SNAP INC.

    Abstract: Systems and methods herein describe novel motion representations for animating articulated objects consisting of distinct parts. The described systems and method access source image data, identify driving image data to modify image feature data in the source image sequence data, generate, using an image transformation neural network, modified source image data comprising a plurality of modified source images depicting modified versions of the image feature data, the image transformation neural network being trained to identify, for each image in the source image data, a driving image from the driving image data, the identified driving image being implemented by the image transformation neural network to modify a corresponding source image in the source image data using motion estimation differences between the identified driving image and the corresponding source image, and stores the modified source image data.

Patent Agency Ranking