公开(公告)号：EP3404659A1

公开(公告)日：2018-11-21

申请号：EP18151014.0

申请日：2018-01-10

Applicant: Apple Inc.

Inventor： STOYLES, Justin D. ,  MOHA, Alexandre R. ,  SCAPEL, Nicholas V. ,  BARLIER, Guillaume P. ,  GUZMAN, Aurelio ,  SOMMER, Bruno M ,  DAMASKY, Nina ,  WEISE, Thibaut ,  GOOSSENS, Thomas ,  PHAM, Hoan ,  AMBERG, Brian

IPC: G11B27/036 ,  G11B27/10 ,  G06T13/20 ,  G06T13/40 ,  G06T17/20

CPC classification number: G06T13/40 ,  G06K9/00228 ,  G06K9/00302 ,  G06T13/205 ,  G06T17/205 ,  G11B27/036 ,  G11B27/10 ,  H04N7/147 ,  H04N2007/145

Abstract: Systems and methods for generating a video of an emoji that has been puppeted using inputs from image, depth, and audio. The inputs can capture facial expressions of a user, eye, eyebrow, mouth, and head movements. A pose, held by the user, can be detected that can be used to generate supplemental animation. The emoji can further be animated using physical properties associated with the emoji and captured movements. An emoji of a dog can have its ears move in response to an up-and-down movement, or a shaking of the head. The video can be sent in a message to one or more recipients. A sending device can render the puppeted video in accordance with hardware and software capabilities of a recipient's computer device.

公开(公告)号：EP4191587A1

公开(公告)日：2023-06-07

申请号：EP22214668.0

申请日：2018-01-10

Applicant: Apple Inc.

Inventor： STOYLES, Justin D. ,  MOHA, Alexandre R. ,  SCAPEL, Nicholas V. ,  BARLIER, Guillaume P. ,  GUZMAN, Aurelio ,  SOMMER, Bruno M ,  DAMASKY, Nina ,  WEISE, Thibaut ,  GOOSSENS, Thomas ,  PHAM, Hoan ,  AMBERG, Brian

IPC: G11B27/036 ,  G11B27/10 ,  G06T13/20 ,  G06T13/40 ,  G06T17/20

Abstract: A method, comprising receiving, by a device, a plurality of image frames comprising a facial expression of a person. Receiving, by the device, depth information comprising the facial expression of the person. Determining, by the device, the facial expression of the person based on the plurality of image frames and the depth information. Animating, by the device, an avatar based at least in part on the facial expression of the person. Causing a first version of the animated avatar to be rendered, by the device, based on the facial expression. Transmitting recipient information from the device to a message system for a transmission to a recipient computing device associated with the recipient information. Receiving, at the device, a response from the message system prior to delivery of the rendered first version of the animated avatar to the recipient computing device. Causing, following the response from the message system, a second version of the animated avatar to be rendered at the device based on the facial expression, the second version corresponding to one or more capabilities of the recipient computing device associated with the recipient information. Transmitting the rendered second version of the animated avatar from the device to the recipient computing device without transmitting the first version of the animated avatar from the device to the recipient computing device.

公开(公告)号：EP3624066A3

公开(公告)日：2020-04-22

申请号：EP19196073.1

申请日：2019-09-07

Applicant: Apple Inc.

Inventor： BURNS, Aaron M. ,  SOMMER, Bruno M ,  ORIOL, Timothy

IPC: G06T19/00 ,  G06T19/20

Abstract: Various implementations disclosed herein include devices, systems, and methods that enable a device to provide a view of virtual elements and a physical environment where the presentation of the virtual elements is based on positioning relative to the physical environment. In one example, a device is configured to detect a change in positioning of a virtual element, for example, when a virtual element is added, moved, or the physical environment around the virtual element is changed. The location of the virtual element in the physical environment is used to detect an attribute of the physical environment upon which the presentation of the virtual element depends. Thus, the device is further configured to detect an attribute ( e.g. , surface, table, mid-air, etc.) of the physical environment based on the placement of the virtual element and present the virtual element based on the detected attribute.

公开(公告)号：EP3624066A2

公开(公告)日：2020-03-18

申请号：EP19196073.1

申请日：2019-09-07

Applicant: Apple Inc.

Inventor： BURNS, Aaron M. ,  SOMMER, Bruno M ,  ORIOL, Timothy

IPC: G06T19/00 ,  G06T19/20

Abstract: Various implementations disclosed herein include devices, systems, and methods that enable a device to provide a view of virtual elements and a physical environment where the presentation of the virtual elements is based on positioning relative to the physical environment. In one example, a device is configured to detect a change in positioning of a virtual element, for example, when a virtual element is added, moved, or the physical environment around the virtual element is changed. The location of the virtual element in the physical environment is used to detect an attribute of the physical environment upon which the presentation of the virtual element depends. Thus, the device is further configured to detect an attribute ( e.g. , surface, table, mid-air, etc.) of the physical environment based on the placement of the virtual element and present the virtual element based on the detected attribute.