公开(公告)号：US20240211035A1

公开(公告)日：2024-06-27

申请号：US18390084

申请日：2023-12-20

Applicant: Apple Inc.

Inventor： Arthur Y. Zhang ,  Ray L. Chang ,  Yanli Zhang ,  Luke A. Pillans ,  Ryan J. Dunn ,  Jeffrey N. Gleason ,  Christian Moore ,  Simon Fortin-Deschenes ,  Emmanuel Piuze-Phaneuf

IPC: G06F3/01 ,  G06F1/16 ,  H04N23/62

CPC classification number: G06F3/013 ,  G06F1/163 ,  H04N23/62

Abstract: Various implementations disclosed herein include devices, systems, and methods that adjust a focus of a camera based on a distance associated with a determined user attention. For example, an example process may include obtaining sensor data from one or more sensors in a physical environment. The process may include determining at least one gaze direction of at least one eye based on the sensor data. The process may further include determining a distance associated with user attention based on a convergence determined based on an intersection of gaze directions of the at least one gaze direction, or a distance of an object in a 3D representation of the physical environment based on the at least one gaze direction. The process may further include adjusting a focus of a camera of the one or more sensors based on the distance associated with the user attention.

公开(公告)号：US20210090323A1

公开(公告)日：2021-03-25

申请号：US17028887

申请日：2020-09-22

Applicant: Apple Inc.

Inventor： Siddharth S. Hazra ,  William J. Dobbie ,  Moinul H. Khan ,  Yanli Zhang ,  Yohan Rajan ,  Arthur Y. Zhang

IPC: G06T15/20 ,  G06F3/01 ,  G06T7/73 ,  G06T19/00

Abstract: Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.

公开(公告)号：US11308685B2

公开(公告)日：2022-04-19

申请号：US17028887

申请日：2020-09-22

Applicant: Apple Inc.

Inventor： Siddharth S. Hazra ,  William J. Dobbie ,  Moinul H. Khan ,  Yanli Zhang ,  Yohan Rajan ,  Arthur Y. Zhang

IPC: G06T15/20 ,  G06T7/73 ,  G06F3/01 ,  G06T19/00

Abstract: Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.

公开(公告)号：US11301969B1

公开(公告)日：2022-04-12

申请号：US16575994

申请日：2019-09-19

Applicant: Apple Inc.

Inventor： Moinul Khan ,  Simon Fortin-Deschenes ,  Yanli Zhang ,  Bennett S. Wilburn ,  Sterling G. Orsten ,  Nan Zhu ,  James Zhou

IPC: G06T5/00 ,  G02B27/01 ,  G02B27/00 ,  G06T19/00 ,  G06F3/01

Abstract: Some implementations provide improved user experiences on head mounted devices (HMDs) that provide near eye viewing, e.g., HMDs that display distorted images and provide lenses that undistort the images for the user. The images are produced using distortion that is corrected dynamically based on context to conserve device resources. To do so, a context associated with a state of the user, the HMD, or content being viewed on the HMD is tracked during the user experience. For example, the device may predict pupil position, eye state, eye gaze direction, or eye fixation, content type, connection mode, and other context. The device uses the tracked context to determine how to correct distortion for the images at different points during the user experience. For example, new distortion corrections may be computed and used while the user's gaze is moving and previously-determined distortion corrections may be used while the user's gaze is fixed.

公开(公告)号：US11048082B1

公开(公告)日：2021-06-29

申请号：US16377500

申请日：2019-04-08

Applicant: Apple Inc.

Inventor： Aleksandr M. Movshovich ,  Yanli Zhang ,  Paul V. Johnson ,  Holly E. Gerhard ,  Arthur Y. Zhang ,  Moinul H. Khan

IPC: G02B27/01 ,  H04N13/385 ,  H04L1/00 ,  G06F3/01 ,  G02B27/00

Abstract: One exemplary implementation involves performing operations at an electronic device with one or more processors and a computer-readable storage medium. The device establishes a wireless communication link with a host device. The device receives, from the host device, a left eye frame and a right eye frame via a sequence of interleaved left eye frame transmissions and right eye frame transmissions. The device loads the left eye frame into a left eye display device and loads the right eye frame into a right eye display device on the electronic device, where the loading includes sequentially loading left eye frame portions and right eye frame portions as the sequence of interleaved left eye frame transmissions and right eye frame transmissions is received. The device then concurrently displays the left eye frame and the right eye frame at the electronic device. The device switches data transmissions schemes according to wireless communication link quality and eye gaze tracking.