DISPLAY SYSTEM HAVING WORLD AND USER SENSORS
    1.
    发明申请
    DISPLAY SYSTEM HAVING WORLD AND USER SENSORS 审中-公开
    显示系统拥有世界和用户传感器

    公开(公告)号:WO2018057991A1

    公开(公告)日:2018-03-29

    申请号:PCT/US2017/053100

    申请日:2017-09-22

    Applicant: APPLE INC.

    Abstract: A mixed reality system that includes a head-mounted display (HMD) that provides 3D virtual views of a user's environment augmented with virtual content. The HMD may include sensors that collect information about the user's environment (e.g., video, depth information, lighting information, etc.), and sensors that collect information about the user (e.g., the user's expressions, eye movement, hand gestures, etc.). The sensors provide the information as inputs to a controller that renders frames including virtual content based at least in part on the inputs from the sensors. The HMD may display the frames generated by the controller to provide a 3D virtual view including the virtual content and a view of the user's environment for viewing by the user.

    Abstract translation: 包括头戴式显示器(HMD)的混合现实系统提供用虚拟内容增强的用户环境的3D虚拟视图。 HMD可以包括收集关于用户的环境(例如,视频,深度信息,照明信息等)的信息的传感器以及收集关于用户的信息(例如,用户的表情,眼球运动,手势等等)的传感器 )。 传感器将信息作为输入提供给控制器,该控制器至少部分基于来自传感器的输入来渲染包括虚拟内容的帧。 HMD可以显示由控制器生成的帧以提供包括虚拟内容和用户环境视图的3D虚拟视图供用户查看。

    HAND-GESTURE ACTIVATION OF ACTIONABLE ITEMS
    4.
    发明公开

    公开(公告)号:EP4296826A1

    公开(公告)日:2023-12-27

    申请号:EP23180382.6

    申请日:2023-06-20

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of performing an action is performed at a device including an image sensor, one or more processors, and non-transitory memory. The method includes receiving, from the image sensor, one or more images of a physical environment. The method includes detecting, in the one or more images of the physical environment, one or more actionable items respectively associated with one or more actions. The method includes detecting, in the one or more images of the physical environment, a hand gesture indicating a particular actionable item. The method includes in response to detecting the hand gesture, performing an action associated with the particular actionable item.

Patent Agency Ranking