公开(公告)号：US11087558B1

公开(公告)日：2021-08-10

申请号：US17026855

申请日：2020-09-21

Applicant: Apple Inc.

Inventor： Michael Kuhn ,  Justin D. Stoyles

IPC: G06T19/00 ,  H04N21/475 ,  G06K9/00 ,  H04W4/30 ,  G02B27/01

Abstract: The present disclosure relates to managing augmented reality content created on a first electronic device and viewed at a second electronic device. In some embodiments, the first electronic device determines its physical location, receives input representing user-generated augmented reality content, displays an augmented reality environment including the user-generated augmented reality content overlaid on a live view of the physical location, and sends the user-generated augmented reality content to an external storage repository. The second electronic device can then receive the user-generated augmented reality content, determine whether it is at the physical location, and display the user-generated augmented reality content when it is at the physical location.

公开(公告)号：US10820795B1

公开(公告)日：2020-11-03

申请号：US16015683

申请日：2018-06-22

Applicant: Apple Inc.

Inventor： Thibaut Weise ,  Justin D. Stoyles ,  Michael Kuhn ,  Reinhard Klapfer ,  Stefan Misslinger

IPC: A61B3/11 ,  G02C13/00 ,  G02B27/01 ,  G06K9/20 ,  G02B7/02

Abstract: In one implementation, a method includes: determining an interpupillary distance (IPD) measurement for a user based on a function of depth data obtained by the depth sensor and image data obtained by the image sensor; and calibrating a head-mounted device (HMD) provided to deliver augmented reality/virtual reality (AR/VR) content by setting one or more presentation parameters of the HMD based on the IPD measurement in order to tailor one or more AR/VR displays of the HMD to a field-of-view of the user.

公开(公告)号：US11762620B2

公开(公告)日：2023-09-19

申请号：US17534102

申请日：2021-11-23

Applicant: Apple Inc.

Inventor： Justin D. Stoyles ,  Michael Kuhn

IPC: G06F3/14 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20

CPC classification number: G06F3/1423 ,  G02B27/0093 ,  G02B27/017 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/04815 ,  G06F3/04842 ,  G06T7/74 ,  G06T19/006 ,  G06V20/20 ,  G06V40/20 ,  H04B5/0025 ,  G02B2027/0187

Abstract: In an exemplary process for accessing a function of an external device through a computer-generated reality interface, one or more external devices are detected. Image data of a physical environment captured by an image sensor is obtained. The process determines whether the image data includes a representation of a first external device of the one or more detected external devices. In accordance with determining that the image data includes a representation of the first external device, the process causing a display to concurrently display a representation of the physical environment according to the image data, and an affordance corresponding to a function of the first external device, wherein detecting user activation of the displayed affordance causes the first external device to perform an action corresponding to the function.

公开(公告)号：US10210648B2

公开(公告)日：2019-02-19

申请号：US15809875

申请日：2017-11-10

Applicant: Apple Inc.

Inventor： Justin D. Stoyles ,  Alexandre R. Moha ,  Nicolas V. Scapel ,  Guillaume P. Barlier ,  Aurelio Guzman ,  Bruno M. Sommer ,  Nina Damasky ,  Thibaut Weise ,  Thomas Goossens ,  Hoan Pham ,  Brian Amberg

IPC: G06K9/00 ,  G06T13/40 ,  H04N7/14

Abstract: Systems and methods for generating a video of an emoji that has been puppeted using inputs from image, depth, and audio. The inputs can capture facial expressions of a user, eye, eyebrow, mouth, and head movements. A pose, held by the user, can be detected that can be used to generate supplemental animation. The emoji can further be animated using physical properties associated with the emoji and captured movements. An emoji of a dog can have its ears move in response to an up-and-down movement, or a shaking of the head. The video can be sent in a message to one or more recipients. A sending device can render the puppeted video in accordance with hardware and software capabilities of a recipient's computer device.

公开(公告)号：US12099773B2

公开(公告)日：2024-09-24

申请号：US18229059

申请日：2023-08-01

Applicant: Apple Inc.

Inventor： Justin D. Stoyles ,  Michael Kuhn

IPC: G06F3/14 ,  G02B27/00 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0346 ,  G06F3/04815 ,  G06F3/04842 ,  G06T7/73 ,  G06T19/00 ,  G06V20/20 ,  G06V40/20 ,  H04B5/70

CPC classification number: G06F3/1423 ,  G02B27/0093 ,  G02B27/017 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/04815 ,  G06F3/04842 ,  G06T7/74 ,  G06T19/006 ,  G06V20/20 ,  G06V40/20 ,  H04B5/70 ,  G02B2027/0187

Abstract: In an exemplary process for accessing a function of an external device through a computer-generated reality interface, one or more external devices are detected. Image data of a physical environment captured by an image sensor is obtained. The process determines whether the image data includes a representation of a first external device of the one or more detected external devices. In accordance with determining that the image data includes a representation of the first external device, the process causes a display to concurrently display a representation of the physical environment according to the image data, and an affordance corresponding to a function of the first external device, wherein detecting user activation of the displayed affordance causes the first external device to perform an action corresponding to the function.

公开(公告)号：US11227494B1

公开(公告)日：2022-01-18

申请号：US16140211

申请日：2018-09-24

Applicant: Apple Inc.

Inventor： Justin D. Stoyles ,  Michael Kuhn

IPC: G08G1/13 ,  G08G1/137 ,  G06T19/00 ,  G01C21/36

Abstract: The present disclosure relates to providing transit information in an augmented reality environment. In some embodiments, images are obtained using one or more image sensors, a determination is made whether the obtained images include a map, and, in accordance with a set of one or more conditions being satisfied, transit information is displayed in the augmented reality environment. A location of the displayed transit information in the augmented reality environment may correspond to a respective feature of the map.

公开(公告)号：US11120600B2

公开(公告)日：2021-09-14

申请号：US16276535

申请日：2019-02-14

Applicant: Apple Inc.

Inventor： Justin D. Stoyles ,  Alexandre R. Moha ,  Nicolas V. Scapel ,  Guillaume P. Barlier ,  Aurelio Guzman ,  Bruno M. Sommer ,  Nina Damasky ,  Thibaut Weise ,  Thomas Goossens ,  Hoan Pham ,  Brian Amberg

IPC: G06T13/40 ,  G06K9/00 ,  H04N7/14 ,  G11B27/036 ,  G11B27/10 ,  G06T13/20 ,  G06T17/20

Abstract: Systems and methods for generating a video of an emoji that has been puppeted using inputs from image, depth, and audio. The inputs can capture facial expressions of a user, eye, eyebrow, mouth, and head movements. A pose, held by the user, can be detected that can be used to generate supplemental animation. The emoji can further be animated using physical properties associated with the emoji and captured movements. An emoji of a dog can have its ears move in response to an up-and-down movement, or a shaking of the head. The video can be sent in a message to one or more recipients. A sending device can render the puppeted video in accordance with hardware and software capabilities of a recipient's computer device.

公开(公告)号：US11087559B1

公开(公告)日：2021-08-10

申请号：US17088265

申请日：2020-11-03

Applicant: Apple Inc.

Inventor： Michael Kuhn ,  Justin D. Stoyles

IPC: G06T19/00 ,  G06K9/00 ,  H04W4/30 ,  H04N21/475 ,  G02B27/01

Abstract: The present disclosure relates to managing augmented reality content created on a first electronic device and viewed at a second electronic device. In some embodiments, the first electronic device determines its physical location, receives input representing user-generated augmented reality content, displays an augmented reality environment including the user-generated augmented reality content overlaid on a live view of the physical location, and sends the user-generated augmented reality content to an external storage repository. The second electronic device can then receive the user-generated augmented reality content, determine whether it is at the physical location, and display the user-generated augmented reality content when it is at the physical location.

公开(公告)号：US20180336714A1

公开(公告)日：2018-11-22

申请号：US15809875

申请日：2017-11-10

Applicant: Apple Inc.

Inventor： Justin D. Stoyles ,  Alexandre R. Moha ,  Nicolas V. Scapel ,  Guillaume P. Barlier ,  Aurelio Guzman ,  Bruno M. Sommer ,  Nina Damasky ,  Thibaut Weise ,  Thomas Goossens ,  Hoan Pham ,  Brian Amberg

IPC: G06T13/40 ,  G06K9/00 ,  H04N7/14

CPC classification number: G06T13/40 ,  G06K9/00228 ,  G06K9/00302 ,  G06T13/205 ,  G06T17/205 ,  G11B27/036 ,  G11B27/10 ,  H04N7/147 ,  H04N2007/145

Abstract: Systems and methods for generating a video of an emoji that has been puppeted using inputs from image, depth, and audio. The inputs can capture facial expressions of a user, eye, eyebrow, mouth, and head movements. A pose, held by the user, can be detected that can be used to generate supplemental animation. The emoji can further be animated using physical properties associated with the emoji and captured movements. An emoji of a dog can have its ears move in response to an up-and-down movement, or a shaking of the head. The video can be sent in a message to one or more recipients. A sending device can render the puppeted video in accordance with hardware and software capabilities of a recipient's computer device.

公开(公告)号：US12260144B2

公开(公告)日：2025-03-25

申请号：US18235693

申请日：2023-08-18

Applicant: Apple Inc.

Inventor： Justin D. Stoyles ,  Michael Kuhn

IPC: G06F3/14 ,  G02B27/00 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0346 ,  G06F3/04815 ,  G06F3/04842 ,  G06T7/73 ,  G06T19/00 ,  G06V20/20 ,  G06V40/20 ,  H04B5/70

Abstract: In some exemplary processes for controlling an external device using a computer-generated reality interface, a view of a physical environment that includes the external device is provided through the display, and information specifying a function of the external device is received from the external device. While the view of the physical environment is being provided, an affordance corresponding to the function is displayed at a position on the display that overlays at least a portion of the external device.