-
公开(公告)号:US20240386819A1
公开(公告)日:2024-11-21
申请号:US18662883
申请日:2024-05-13
Applicant: Apple Inc.
Inventor: Michael J. Rockwell , Oriel Y. Bergig , Geoffrey Stahl , Thibaut Weise , Peter Kaufmann , Branko Petljanski , Jason L. Slupeiks , Tom Sengelaub , Kathrin Berkner Cieslicki , Yanghai Tsin , Hesam Najafi , Arthur Y. Zhang , Julian Hoenig , Julian Jaede , Yoonhoo Jo , Forrest C. Wang , Bertrand Nepveu , Muhammad F. Hossain , William A. Sorrentino, III , Jonathan Ive , Alan C. Dye , Stephen O. Lemay , Jeffrey M. Faulkner
IPC: G09G3/00 , G06F1/16 , G06F3/01 , G06F3/02 , G06F3/0362
Abstract: A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.
-
公开(公告)号:US11838486B1
公开(公告)日:2023-12-05
申请号:US16927763
申请日:2020-07-13
Applicant: Apple Inc.
Inventor: Samer Samir Barakat , Bertrand Nepveu , Vincent Chapdelaine-Couture
IPC: H04N13/117 , H04N13/344 , H04N13/00
CPC classification number: H04N13/117 , H04N13/344 , H04N2013/0081
Abstract: In one implementation, a method of performing perspective correction is performed at a head-mounted device including one or more processors, non-transitory memory, an image sensor, and a display. The method includes capturing, using the image sensor, a plurality of images of a scene from a respective plurality of perspectives. The method includes capturing, using the image sensor, a current image of the scene from a current perspective. The method includes obtaining a depth map of the current image of the scene. The method include transforming, using the one or more processors, the current image of the scene based on the depth map, a difference between the current perspective of the image sensor and a current perspective of a user, and at least one of the plurality of images of the scene from the respective plurality of perspectives. The method includes displaying, on the display, the transformed image.
-
公开(公告)号:US11778154B2
公开(公告)日:2023-10-03
申请号:US16637087
申请日:2018-08-08
Applicant: Apple Inc.
Inventor: Vincent Chapdelaine-Couture , Anthony Ghannoum , Yan Cote , Irving Lustigman , Marc-Andre Chenier , Simon Fortin-Deschenes , Bertrand Nepveu
IPC: G06T19/00 , H04N9/75 , H04N13/344 , H04N5/265
CPC classification number: H04N9/75 , G06T19/006 , H04N5/265 , H04N13/344
Abstract: A Head-Mounted Display with camera sensors to perform chroma keying in a mixed reality context is presented. Low latency is achieved by embedding the processing in the HMD itself, specifically, format camera images, detect the selected color range and make a composite with the virtual content.
-
公开(公告)号:US20230053205A1
公开(公告)日:2023-02-16
申请号:US17979630
申请日:2022-11-02
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Marc-Andre Chenier , Yan Cote , Yves Millette
Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.
-
公开(公告)号:US11521291B1
公开(公告)日:2022-12-06
申请号:US17215151
申请日:2021-03-29
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Marc-Andre Chenier , Yan Cote , Yves Millette
Abstract: In some implementations, a method of reducing latency associated with an image read-out operation is performed at a device including one or more processors, non-transitory memory, an image processing architecture, and an image capture device. The method includes: obtaining first image data corresponding to a physical environment; reading a first slice of the first image data into an input buffer; performing processing operations on the first slice of the first image data to obtain a first portion of second image data; reading a second slice of the first image data into the input buffer; performing the image processing operations on the second slice of the first image data to obtain a second portion of the second image data; and generating an image frame of the physical environment based at least in part on the first and second portions of the second image data.
-
公开(公告)号:US12260493B2
公开(公告)日:2025-03-25
申请号:US18089664
申请日:2022-12-28
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Vincent Chapdelaine-Couture , Emmanuel Piuze-Phaneuf
Abstract: The method includes: obtaining a first image of an environment from a first image sensor associated with first intrinsic parameters; performing a warping operation on the first image according to perspective offset values to generate a warped first image in order to account for perspective differences between the first image sensor and a user of the electronic device; determining an occlusion mask based on the warped first image that includes a plurality of holes; obtaining a second image of the environment from a second image sensor associated with second intrinsic parameters; normalizing the second image based on a difference between the first and second intrinsic parameters to produce a normalized second image; and filling a first set of one or more holes of the occlusion mask based on the normalized second image to produce a modified first image.
-
公开(公告)号:US20240386679A1
公开(公告)日:2024-11-21
申请号:US18662906
申请日:2024-05-13
Applicant: Apple Inc.
Inventor: Michael J. Rockwell , Geoffrey Stahl , Thibaut Weise , Peter Kaufmann , Branko Petljanski , Jason L. Slupeiks , Tom Sengelaub , Kathrin Berkner Cieslicki , Yanghai Tsin , Hesam Najafi , Arthur Y. Zhang , Julian Hoenig , Julian Jaede , Jason C. Sauers , James W. Vandyke , Yoonhoo Jo , Forrest C. Wang , Cheng Chen , Graham B. Myhre , Fletcher R. Rothkopf , Marinus Meursing , Phil M. Hobson , Jan K. Quijalvo , Jia Tao , Ivan S. Maric , Jeremy C. Franklin , Wey-Jiun Lin , Bertrand Nepveu , Muhammad F. Hossain , William A. Sorrentino, III , Jonathan Ive , Alan C. Dye , Stephen O. Lemay
Abstract: A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.
-
公开(公告)号:US12125123B2
公开(公告)日:2024-10-22
申请号:US18209643
申请日:2023-06-14
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Marc-Andre Chenier , Yan Cote , Yves Millette
CPC classification number: G06T1/20 , G06T5/73 , G06T5/90 , G06T7/73 , G06T15/005 , G06T15/20 , G06T19/006
Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.
-
公开(公告)号:US12094069B2
公开(公告)日:2024-09-17
申请号:US18233653
申请日:2023-08-14
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Sandy J. Carter , Vincent Chapdelaine-Couture , Marc-Andre Chenier , Yan Cote , Simon Fortin-Deschênes , Anthony Ghannoum , Tomlinson Holman , Marc-Olivier Lepage , Yves Millette
IPC: G06T19/00 , G06F3/01 , G06F3/16 , G06T5/00 , G06T11/00 , H04N13/117 , H04N13/156 , H04N13/194 , G02B27/01 , G06F7/32
CPC classification number: G06T19/006 , G06F3/011 , G06F3/165 , G06T5/00 , G06T11/00 , H04N13/117 , H04N13/156 , H04N13/194 , G02B2027/0138 , G02B27/0179 , G06F7/32
Abstract: The present disclosure relates to techniques for presenting a combined view of a virtual environment and a real environment in response to detecting a transition event associated with an object in the real environment. While presenting the combined view, if an input of a first type is detected, the combined view is adjusted by increasing the visibility of imagery of the virtual environment and decreasing the visibility of imagery of the real environment. If an input of a second type is detected, the combined view is adjusted by decreasing the visibility of the imagery of the virtual environment and increasing the visibility of the imagery of the real environment.
-
10.
公开(公告)号:US11880911B2
公开(公告)日:2024-01-23
申请号:US17272025
申请日:2019-09-06
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Sandy J. Carter , Vincent Chapdelaine-Couture , Marc-Andre Chenier , Yan Cote , Simon Fortin-Deschênes , Anthony Ghannoum , Tomlinson Holman , Marc-Olivier Lepage , Yves Millette
IPC: G06T11/00 , G06F3/16 , H04N13/117 , H04N13/156 , H04N13/194 , G02B27/01 , G06F3/01
CPC classification number: G06T11/00 , G02B27/0179 , G06F3/011 , G06F3/165 , H04N13/117 , H04N13/156 , H04N13/194 , G02B2027/0138
Abstract: The present disclosure relates to techniques for transitioning between imagery and sounds of two different environments, such as a virtual environment and a real environment. A view of a first environment and audio associated with the first environment are provided. In response to detecting a transition event, a view of the first environment combined with a second environment is provided. The combined view includes imagery of the first environment at a first visibility value and imagery of the second environment at a second visibility value. In addition, in response to detecting a transition event, the first environment audio is mixed with audio associated with the second environment.
-
-
-
-
-
-
-
-
-