公开(公告)号：WO2018057991A1

公开(公告)日：2018-03-29

申请号：PCT/US2017/053100

申请日：2017-09-22

Applicant: APPLE INC.

Inventor： MOTTA, Ricardo J. ,  MILLER, Brett D. ,  RICK, Tobias ,  SRIKANTH, Manohar B.

IPC: G06F1/16 ,  G06F3/01

CPC classification number: G06T19/006 ,  G02B27/0093 ,  G02B27/0172 ,  G02B2027/0136 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0187 ,  G06F1/163 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/015 ,  G06F3/017 ,  H04N13/344 ,  H04N13/383

Abstract: A mixed reality system that includes a head-mounted display (HMD) that provides 3D virtual views of a user's environment augmented with virtual content. The HMD may include sensors that collect information about the user's environment (e.g., video, depth information, lighting information, etc.), and sensors that collect information about the user (e.g., the user's expressions, eye movement, hand gestures, etc.). The sensors provide the information as inputs to a controller that renders frames including virtual content based at least in part on the inputs from the sensors. The HMD may display the frames generated by the controller to provide a 3D virtual view including the virtual content and a view of the user's environment for viewing by the user.

Abstract translation: 包括头戴式显示器（HMD）的混合现实系统提供用虚拟内容增强的用户环境的3D虚拟视图。 HMD可以包括收集关于用户的环境（例如，视频，深度信息，照明信息等）的信息的传感器以及收集关于用户的信息（例如，用户的表情，眼球运动，手势等等）的传感器 ）。 传感器将信息作为输入提供给控制器，该控制器至少部分基于来自传感器的输入来渲染包括虚拟内容的帧。 HMD可以显示由控制器生成的帧以提供包括虚拟内容和用户环境视图的3D虚拟视图供用户查看。

公开(公告)号：EP3488315A1

公开(公告)日：2019-05-29

申请号：EP17780948.0

申请日：2017-09-22

Applicant: Apple Inc.

Inventor： MOTTA, Ricardo J. ,  MILLER, Brett D. ,  RICK, Tobias ,  SRIKANTH, Manohar B.

IPC: G06F1/16 ,  G06F3/01

公开(公告)号：EP4113260A2

公开(公告)日：2023-01-04

申请号：EP22173104.5

申请日：2022-05-12

Applicant: Apple Inc.

Inventor： LU, Jean Hsiang-Chun ,  ZHANG, Bosheng ,  CIESLICKI, Kathrin Berkner ,  SRIKANTH, Manohar B. ,  BEDARD, Noah D. ,  SUN, Ting

IPC: G06F3/0354 ,  G01J3/46

Abstract: A device such as a stylus may have a color sensor. The color sensor may have a color sensing light detector having a plurality of photodetectors each of which measures light for a different respective color channel. The color sensor may also have a light emitter. The light emitter may have an adjustable light spectrum. The light spectrum may be adjusted during color sensing measurements using information such as ambient light color measurements made with a color ambient light sensor that has a plurality of photodetectors each of which measures light for a different respective color channel. An inertial measurement unit may be used to measure the angular orientation between the stylus and an external object during color measurements. Arrangements in which the light emitter is modulated during color sensing may also be used. Measurements from the stylus may be transmitted wirelessly to external equipment.

公开(公告)号：EP3485635A1

公开(公告)日：2019-05-22

申请号：EP17752507.8

申请日：2017-07-07

Applicant: Apple Inc.

Inventor： MOTTA, Ricardo J. ,  VONDRAN, Gary L. ,  SRIKANTH, Manohar B. ,  MILLER, Brett D.

IPC: H04N7/14 ,  H04N7/18

公开(公告)号：EP4113260A3

公开(公告)日：2023-02-15

申请号：EP22173104.5

申请日：2022-05-12

Applicant: Apple Inc.

Inventor： LU, Jean Hsiang-Chun ,  ZHANG, Bosheng ,  CIESLICKI, Kathrin Berkner ,  SRIKANTH, Manohar B. ,  BEDARD, Noah D. ,  SUN, Ting

IPC: G06F3/0354 ,  G01J3/46

Abstract: A device such as a stylus may have a color sensor. The color sensor may have a color sensing light detector having a plurality of photodetectors each of which measures light for a different respective color channel. The color sensor may also have a light emitter. The light emitter may have an adjustable light spectrum. The light spectrum may be adjusted during color sensing measurements using information such as ambient light color measurements made with a color ambient light sensor that has a plurality of photodetectors each of which measures light for a different respective color channel. An inertial measurement unit may be used to measure the angular orientation between the stylus and an external object during color measurements. Arrangements in which the light emitter is modulated during color sensing may also be used. Measurements from the stylus may be transmitted wirelessly to external equipment.