CROSS-DOMAIN NEURAL NETWORKS FOR SYNTHESIZING IMAGE WITH FAKE HAIR COMBINED WITH REAL IMAGE

    公开(公告)号:WO2022047463A1

    公开(公告)日:2022-03-03

    申请号:PCT/US2021/071239

    申请日:2021-08-20

    Applicant: SNAP INC.

    Abstract: A messaging system performs neural network hair rendering for images provided by users of the messaging system. A method of neural network hair rendering includes processing a three-dimensional (3D) model of fake hair and a first real hair image depicting a first person to generate a fake hair structure, and encoding, using a fake hair encoder neural subnetwork, the fake hair structure to generate a coded fake hair structure. The method further includes processing, using a cross-domain structure embedding neural subnetwork, the coded fake hair structure to generate a fake and real hair structure, and encoding, using an appearance encoder neural subnetwork, a second real hair image depicting a second person having a second head to generate an appearance map. The method further includes processing, using a real appearance renderer neural subnetwork, the appearance map and the fake and real hair structure to generate a synthesized real image.

    AUGMENTED REALITY USER INTERFACE CONTROL
    3.
    发明申请

    公开(公告)号:WO2019126526A1

    公开(公告)日:2019-06-27

    申请号:PCT/US2018/066841

    申请日:2018-12-20

    Applicant: SNAP INC.

    Abstract: Systems, devices, media, and methods are presented for controlling user interface with an object depicted within the user interface. The systems and methods initiates an augmented reality mode configured to present augmented reality elements within a graphical user interface. A face is detected within a field of view of an image capture component and presented within the graphical user interface. In response to detecting the face, the systems and methods sequentially present a set of augmented reality elements within the graphical user interface. A subset of the augmented reality elements and the face may be depicted contemporaneously. A movement is detected of at least a portion of the face relative to a first augmented reality element and presentation of the first augmented reality element is modified and at least one second augmented reality element is presented.

Patent Agency Ranking