公开(公告)号：US12198276B2

公开(公告)日：2025-01-14

申请号：US16926113

申请日：2020-07-10

Applicant: Apple Inc.

Inventor： Sheng Zhang ,  Aleksandr M. Movshovich ,  Arthur Y. Zhang ,  Chaohao Wang ,  Moinul H. Khan ,  Paolo Sacchetto ,  Yunhui Hou

IPC: G06T19/00 ,  G02B27/01 ,  H04N5/232 ,  H04N23/667 ,  H04N23/951

Abstract: An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.

公开(公告)号：US20240404185A1

公开(公告)日：2024-12-05

申请号：US18672958

申请日：2024-05-23

Applicant: Apple Inc.

Inventor： Christian I. Moore ,  Moinul H. Khan ,  Seyedkoosha Mirhosseini ,  Simon Fortin-Deschenes

IPC: G06T15/50 ,  G06T3/18

Abstract: In one implementation, a method of pipelined blending an image with virtual content is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes capturing, with the image sensor, a first portion of an image of a physical environment. The method includes warping the first portion of the image of the physical environment to generate a warped first portion. The method includes blending the warped first portion with a first portion of virtual content to generate a blended first portion. The method includes displaying, on the display, the blended first portion. The method includes capturing, with the image sensor, a second portion of the image of the physical environment. The method includes warping the second portion of the image of the physical environment to generate a warped second portion. The method includes blending the warped second portion with a second portion of the virtual content to generate a blended second portion. The method includes displaying, on the display, the blended second portion, wherein displaying the blended first portion is initiated before blending the warped second portion is completed.

公开(公告)号：US20230396824A1

公开(公告)日：2023-12-07

申请号：US18329040

申请日：2023-06-05

Applicant: Apple Inc.

Inventor： Moinul H. Khan ,  Jim C. Chou ,  Sorin C. Cismas

IPC: H04N21/2662 ,  H04N19/59 ,  H04L1/00 ,  H04W72/542

CPC classification number: H04N21/2662 ,  H04N19/59 ,  H04L1/0009 ,  H04L1/0003 ,  H04W72/542

Abstract: An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.

公开(公告)号：US11818419B2

公开(公告)日：2023-11-14

申请号：US16586522

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Moinul H. Khan ,  Katharina Buckl ,  Venu M. Duggineni ,  Aleksandr M. Movshovich ,  Sreeraman Anantharaman ,  Phillip N. Smith

IPC: H04N21/435 ,  H04N21/431 ,  H04N21/44 ,  H04W28/02 ,  H04N21/442 ,  H04N21/462 ,  H04N21/4402

CPC classification number: H04N21/4355 ,  H04N21/431 ,  H04N21/4402 ,  H04N21/44008 ,  H04N21/44209 ,  H04N21/4621 ,  H04W28/0215 ,  H04W28/0268

Abstract: A mobile device includes a display, at least one sensor, and a wireless transceiver. The mobile device also includes control circuitry coupled to the display, the at least one sensor, and the wireless transceiver. The control circuitry is configured to obtain content primitives from the at least one sensor, to perform content provisioning operations to obtain content based at least in part on the content primitives, and to display the obtained content on the display, wherein at least some of the content is virtual content. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that involve increasing an amount of image processing operations performed by the mobile device to obtain the content.

公开(公告)号：US20200342678A1

公开(公告)日：2020-10-29

申请号：US16926113

申请日：2020-07-10

Applicant: Apple Inc.

Inventor： Sheng Zhang ,  Aleksandr M. Movshovich ,  Arthur Y. Zhang ,  Chaohao Wang ,  Moinul H. Khan ,  Paolo Sacchetto ,  Yunhui Hou

IPC: G06T19/00 ,  G02B27/01 ,  H04N5/232

Abstract: An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.