公开(公告)号：US20250148730A1

公开(公告)日：2025-05-08

申请号：US19016230

申请日：2025-01-10

Applicant: Apple Inc.

Inventor： Sheng Zhang ,  Aleksandr M. Movshovich ,  Arthur Y. Zhang ,  Chaohao Wang ,  Moinul H. Khan ,  Paolo Sacchetto ,  Yunhui Hou

IPC: G06T19/00 ,  G02B27/01 ,  H04N23/667 ,  H04N23/951

Abstract: An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.

公开(公告)号：US12192554B2

公开(公告)日：2025-01-07

申请号：US18329040

申请日：2023-06-05

Applicant: Apple Inc.

Inventor： Moinul H. Khan ,  Jim C. Chou ,  Sorin C. Cismas

IPC: H04N21/2662 ,  H04L1/00 ,  H04N19/59 ,  H04W72/542

Abstract: An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.

公开(公告)号：US20250142150A1

公开(公告)日：2025-05-01

申请号：US18964961

申请日：2024-12-02

Applicant: Apple Inc.

Inventor： Moinul H. Khan ,  Jim C. Chou ,  Sorin C. Cismas

IPC: H04N21/2662 ,  H04L1/00 ,  H04N19/59 ,  H04W72/542

Abstract: An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.

公开(公告)号：US20210090323A1

公开(公告)日：2021-03-25

申请号：US17028887

申请日：2020-09-22

Applicant: Apple Inc.

Inventor： Siddharth S. Hazra ,  William J. Dobbie ,  Moinul H. Khan ,  Yanli Zhang ,  Yohan Rajan ,  Arthur Y. Zhang

IPC: G06T15/20 ,  G06F3/01 ,  G06T7/73 ,  G06T19/00

Abstract: Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.

公开(公告)号：US20240107183A1

公开(公告)日：2024-03-28

申请号：US18369399

申请日：2023-09-18

Applicant: Apple Inc.

Inventor： Joseph Cheung ,  Kaushik Raghunath ,  Michael Bekerman ,  Moinul H. Khan ,  Vivaan Bahl ,  Yung-Chin Chen ,  Yuqing Su

IPC: H04N23/86 ,  H04N23/60 ,  H04N23/83

CPC classification number: H04N23/86 ,  H04N23/665 ,  H04N23/83

Abstract: In some implementations, a method of synchronizing a content generation and delivery architecture to reduce the latency associated with image passthrough. The method includes: determining a temporal offset associated with the content generation and delivery architecture to reduce a photon-to-photon latency across the content generation and delivery architecture; obtaining a first reference rate associated with a portion of the content generation and delivery architecture; generating, via synchronization circuitry, a synchronization signal for the content generation and delivery architecture based at least in part on the first reference rate; and operating the content generation and delivery architecture according to the synchronization signal and the temporal offset.

公开(公告)号：US11048082B1

公开(公告)日：2021-06-29

申请号：US16377500

申请日：2019-04-08

Applicant: Apple Inc.

Inventor： Aleksandr M. Movshovich ,  Yanli Zhang ,  Paul V. Johnson ,  Holly E. Gerhard ,  Arthur Y. Zhang ,  Moinul H. Khan

IPC: G02B27/01 ,  H04N13/385 ,  H04L1/00 ,  G06F3/01 ,  G02B27/00

Abstract: One exemplary implementation involves performing operations at an electronic device with one or more processors and a computer-readable storage medium. The device establishes a wireless communication link with a host device. The device receives, from the host device, a left eye frame and a right eye frame via a sequence of interleaved left eye frame transmissions and right eye frame transmissions. The device loads the left eye frame into a left eye display device and loads the right eye frame into a right eye display device on the electronic device, where the loading includes sequentially loading left eye frame portions and right eye frame portions as the sequence of interleaved left eye frame transmissions and right eye frame transmissions is received. The device then concurrently displays the left eye frame and the right eye frame at the electronic device. The device switches data transmissions schemes according to wireless communication link quality and eye gaze tracking.

公开(公告)号：US10748340B1

公开(公告)日：2020-08-18

申请号：US15989756

申请日：2018-05-25

Applicant: Apple Inc.

Inventor： Sheng Zhang ,  Aleksandr M. Movshovich ,  Arthur Y. Zhang ,  Chaohao Wang ,  Moinul H. Khan ,  Paolo Sacchetto ,  Yunhui Hou

IPC: G06T19/00 ,  G02B27/01 ,  H04N5/232

Abstract: An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.

公开(公告)号：US11695977B2

公开(公告)日：2023-07-04

申请号：US16586452

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Moinul H. Khan ,  Jim C. Chou ,  Sorin C. Cismas

IPC: H04N21/2662 ,  H04N19/59 ,  H04W72/08 ,  H04L1/00

CPC classification number: H04N21/2662 ,  H04L1/0003 ,  H04L1/0009 ,  H04N19/59 ,  H04W72/085

Abstract: An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.

公开(公告)号：US11308685B2

公开(公告)日：2022-04-19

申请号：US17028887

申请日：2020-09-22

Applicant: Apple Inc.

Inventor： Siddharth S. Hazra ,  William J. Dobbie ,  Moinul H. Khan ,  Yanli Zhang ,  Yohan Rajan ,  Arthur Y. Zhang

IPC: G06T15/20 ,  G06T7/73 ,  G06F3/01 ,  G06T19/00

Abstract: Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.

公开(公告)号：US11064387B1

公开(公告)日：2021-07-13

申请号：US16411302

申请日：2019-05-14

Applicant: Apple Inc.

Inventor： Aleksandr M. Movshovich ,  Arthur Y. Zhang ,  Hao Pan ,  Holly E. Gerhard ,  Jim C. Chou ,  Moinul H. Khan ,  Paul V. Johnson ,  Sorin C. Cismas ,  Sreeraman Anantharaman ,  William W. Sprague

IPC: H04W28/06 ,  H04W24/08 ,  H04N13/398 ,  H04N13/344 ,  H04N13/194

Abstract: One exemplary implementation involves performing operations at an electronic device with one or more processors and a computer-readable storage medium. The device establishes a wireless communication link with a host device. The device receives, from the host device, a left eye frame and a right eye frame via a sequence of left eye frame transmissions and right eye frame transmissions. The device switches data transmissions schemes according to wireless commination link quality or eye gaze tracking. Adjusting transmission format based on transmission quality of the wireless communication link allows the devices to take advantage of greater bandwidth when available to save power. An additional transmission format is based on alternately transmitting left eye and right eye frames for very low bandwidth.