-
公开(公告)号:WO2018075949A1
公开(公告)日:2018-04-26
申请号:PCT/US2017/057703
申请日:2017-10-20
Applicant: APPLE INC.
Inventor: BERKNER-CIESLICKI, Kathrin , MOTTA, Ricardo J. , LIM, Se Hoon , KIM, Minwoong , SAITO, Kenichi , PETLJANSKI, Branko , SAUERS, Jason C. , SHINOHARA, Yoshikazu
CPC classification number: G06F3/013 , G02B27/0172 , G02B2027/0187 , G06T7/292 , G06T19/006 , H04N5/33
Abstract: An eye tracking system for detecting position and movements of a user's eyes in a head-mounted display (HMD). The eye tracking system may include at least one near-IR (NIR) eye tracking camera positioned at each side of the user's face and pointed towards eye-facing surfaces of eyepieces of the HMD, an illumination source that emits NIR light towards the user's eyes, and hot mirrors located between the eye-facing surfaces of the eyepieces and the user's eyes. The hot mirrors reflect at least a portion of NIR light, while allowing visible light to pass. The cameras capture images of the user's eyes reflected by the hot mirrors. Positioning the hot mirrors at or near the eye-facing surfaces of the eyepieces allows the cameras to be placed at the sides of the user's face without having to image through the eyepieces.
Abstract translation: 用于检测头戴式显示器(HMD)中的用户眼睛的位置和运动的眼睛跟踪系统。 眼睛跟踪系统可以包括:位于用户的脸部的每侧并指向HMD的目镜的面向眼睛的表面的至少一个近IR(NIR)眼睛跟踪相机;朝向用户的眼睛发射NIR光的照明源 以及位于目镜的眼睛朝向表面和使用者眼睛之间的热镜。 热镜反射至少一部分NIR光,同时允许可见光通过。 这些摄像头可以捕捉用热镜反射的用户眼睛的图像。 将热镜放置在目镜的面向眼睛的表面处或其附近,可以将相机放置在用户脸部的两侧,而不必通过目镜进行成像。 p>
-
公开(公告)号:WO2018057991A1
公开(公告)日:2018-03-29
申请号:PCT/US2017/053100
申请日:2017-09-22
Applicant: APPLE INC.
Inventor: MOTTA, Ricardo J. , MILLER, Brett D. , RICK, Tobias , SRIKANTH, Manohar B.
CPC classification number: G06T19/006 , G02B27/0093 , G02B27/0172 , G02B2027/0136 , G02B2027/0138 , G02B2027/014 , G02B2027/0187 , G06F1/163 , G06F3/011 , G06F3/012 , G06F3/013 , G06F3/015 , G06F3/017 , H04N13/344 , H04N13/383
Abstract: A mixed reality system that includes a head-mounted display (HMD) that provides 3D virtual views of a user's environment augmented with virtual content. The HMD may include sensors that collect information about the user's environment (e.g., video, depth information, lighting information, etc.), and sensors that collect information about the user (e.g., the user's expressions, eye movement, hand gestures, etc.). The sensors provide the information as inputs to a controller that renders frames including virtual content based at least in part on the inputs from the sensors. The HMD may display the frames generated by the controller to provide a 3D virtual view including the virtual content and a view of the user's environment for viewing by the user.
Abstract translation: 包括头戴式显示器(HMD)的混合现实系统提供用虚拟内容增强的用户环境的3D虚拟视图。 HMD可以包括收集关于用户的环境(例如,视频,深度信息,照明信息等)的信息的传感器以及收集关于用户的信息(例如,用户的表情,眼球运动,手势等等)的传感器 )。 传感器将信息作为输入提供给控制器,该控制器至少部分基于来自传感器的输入来渲染包括虚拟内容的帧。 HMD可以显示由控制器生成的帧以提供包括虚拟内容和用户环境视图的3D虚拟视图供用户查看。 p>
-
公开(公告)号:WO2020069427A1
公开(公告)日:2020-04-02
申请号:PCT/US2019/053635
申请日:2019-09-27
Applicant: APPLE INC.
Inventor: MOLINA, Gabriel D. , MOTTA, Ricardo J. , VONDRAN JR., Gary L. , LELESCU, Dan , RICK, Tobias , MILLER, Brett
Abstract: A light field panorama system in which a user holding a mobile device performs a gesture to capture images of a scene from different positions. Additional information, for example position and orientation information, may also be captured. The images and information may be processed to determine metadata including the relative positions of the images and depth information for the images. The images and metadata may be stored as a light field panorama. The light field panorama may be processed by a rendering engine to render different 3D views of the scene to allow a viewer to explore the scene from different positions and angles with six degrees of freedom. Using a rendering and viewing system such as a mobile device or head-mounted display, the viewer may see behind or over objects in the scene, zoom in or out on the scene, or view different parts of the scene.
-
公开(公告)号:WO2020069425A1
公开(公告)日:2020-04-02
申请号:PCT/US2019/053631
申请日:2019-09-27
Applicant: APPLE INC.
Inventor: HENNIGAN, Daniel R. , BEDARD, Noah D. , PETLJANSKI, Branko , SAUERS, Jason C. , HUO, Edward S. , MOTTA, Ricardo J. , MILLER, Brett D. , PETROV, Yury
Abstract: A scene camera system that includes two or more mirrors that reflect light from a respective portion of a field of view (FOV) in front of the system and two or more cameras that each capture the light reflected by a respective one of the two or more mirrors. By using the mirrors to reflect the light, the cameras' entrance pupils are imaged to a location closer to a user's eyes to thus achieve a more accurate representation of the perspective of the user.
-
公开(公告)号:EP3485635A1
公开(公告)日:2019-05-22
申请号:EP17752507.8
申请日:2017-07-07
Applicant: Apple Inc.
Inventor: MOTTA, Ricardo J. , VONDRAN, Gary L. , SRIKANTH, Manohar B. , MILLER, Brett D.
-
公开(公告)号:EP3857499A1
公开(公告)日:2021-08-04
申请号:EP19790942.7
申请日:2019-09-27
Applicant: Apple Inc.
Inventor: MOLINA, Gabriel D. , MOTTA, Ricardo J. , VONDRAN JR., Gary L. , LELESCU, Dan , RICK, Tobias , MILLER, Brett
-
公开(公告)号:EP3516444A1
公开(公告)日:2019-07-31
申请号:EP17794543.3
申请日:2017-10-20
Applicant: Apple Inc.
-
公开(公告)号:EP3488315A1
公开(公告)日:2019-05-29
申请号:EP17780948.0
申请日:2017-09-22
Applicant: Apple Inc.
Inventor: MOTTA, Ricardo J. , MILLER, Brett D. , RICK, Tobias , SRIKANTH, Manohar B.
-
-
-
-
-
-
-