-
公开(公告)号:US20240385454A1
公开(公告)日:2024-11-21
申请号:US18662641
申请日:2024-05-13
Applicant: Apple Inc.
Inventor: Ricardo J. Motta , Brett D. Miller , Chad A. Bronstein , Bennett S. Wilburn , Branko Petljanski , Mahmut C. Orsan , David W. Lum , Edward A. Valko , Graham B. Myhre , Wonjae Choi , Manohar B. Srikanth , Michael Slootsky , Nicolas P. Bonnier , Jiaying Wu , ZhiBing Ge , William W. Sprague , Bertrand Nepveu , Michael J. Rockwell , Edward S. Huo , Marinus Meursing , Timothy Y. Chang , Katharina Buckl
IPC: G02B27/01 , G02B7/14 , G02B27/00 , G06F3/01 , H04N13/361
Abstract: A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.
-
公开(公告)号:US20240202866A1
公开(公告)日:2024-06-20
申请号:US18286522
申请日:2022-03-29
Applicant: Apple Inc.
Inventor: Samer Barakat , Bertrand Nepveu , Christian W. Gosch , Emmanuel Piuze-Phaneuf , Vincent Chapdelaine-Couture
CPC classification number: G06T3/18 , G02B27/017 , G06T7/55
Abstract: In one implementation, a method of performing perspective correction of an image is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes capturing, using the image sensor, an image of a physical environment. The method includes obtaining a plurality of initial depths respectively associated with a plurality of pixels of the image of the physical environment. The method includes generating a depth map for the image of the physical environment based on the plurality of initial depths and a respective plurality of confidences of the plurality of initial depths. The method includes transforming, using the one or more processors, the image of the physical environment based on the depth map and a difference between a perspective of the image sensor and a perspective of a user. The method includes displaying, on the display, the transformed image.
-
公开(公告)号:US11790569B2
公开(公告)日:2023-10-17
申请号:US17272251
申请日:2019-09-06
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Sandy J. Carter , Vincent Chapdelaine-Couture , Marc-Andre Chenier , Yan Cote , Simon Fortin-Deschênes , Anthony Ghannoum , Tomlinson Holman , Marc-Olivier Lepage , Yves Millette
IPC: G06T11/00 , G06F3/16 , H04N13/117 , H04N13/156 , H04N13/194 , G02B27/01 , G06F3/01
CPC classification number: G06T11/00 , G02B27/0179 , G06F3/011 , G06F3/165 , H04N13/117 , H04N13/156 , H04N13/194 , G02B2027/0138
Abstract: The present disclosure relates to techniques for inserting imagery from a real environment into a virtual environment. While presenting (e.g., displaying) the virtual environment at an electronic device, a proximity of the electronic device to a physical object located in a real environment is detected. In response to detecting that the proximity of the electronic device to the physical object is less than a first threshold distance, imagery of the physical object is isolated from other imagery of the real environment. The isolated imagery of the physical object is inserted into the virtual environment at a location corresponding to the location of the physical object in the real environment. The imagery of the physical object has a first visibility value associated with the proximity of the electronic device to the physical object.
-
公开(公告)号:US20230325965A1
公开(公告)日:2023-10-12
申请号:US18209643
申请日:2023-06-14
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Marc-Andre Chenier , Yan Cote , Yves Millette
CPC classification number: G06T1/20 , G06T19/006 , G06T7/73 , G06T15/20 , G06T5/003 , G06T15/005 , G06T5/007
Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.
-
公开(公告)号:US11736822B1
公开(公告)日:2023-08-22
申请号:US17176771
申请日:2021-02-16
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Marc-Andre Chenier , Yan Cote , Yves Millette
Abstract: A method includes obtaining a first plurality of image frames that are provided by an image sensor at a first output rate. The method includes determining a GPU temporal processing value characterizing the GPU processing of the first plurality of image frames. The GPU temporal processing value is a function of an amount of information associated with the first plurality of image frames. The method includes determining an operation value associated with the image sensor based on a function of the GPU temporal processing value. The operation value modifies the operation of the image sensor. The method includes changing, using a controller, the operation of the image sensor as a function of the operation value so that the image sensor provides a second plurality of image frames at a second output rate.
-
公开(公告)号:US20250156985A1
公开(公告)日:2025-05-15
申请号:US18922265
申请日:2024-10-21
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Marc-Andre Chenier , Yan Cote , Yves Millette
Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.
-
公开(公告)号:US20230377249A1
公开(公告)日:2023-11-23
申请号:US18089664
申请日:2022-12-28
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Vincent Chapdelaine-Couture , Emmanuel Piuze-Phaneuf
CPC classification number: G06T15/205 , G06T3/0093 , G06T7/70 , G06T7/50 , G06T5/002 , G06T2207/10024 , G06T2207/10028
Abstract: The method includes: obtaining a first image of an environment from a first image sensor associated with first intrinsic parameters; performing a warping operation on the first image according to perspective offset values to generate a warped first image in order to account for perspective differences between the first image sensor and a user of the electronic device; determining an occlusion mask based on the warped first image that includes a plurality of holes; obtaining a second image of the environment from a second image sensor associated with second intrinsic parameters; normalizing the second image based on a difference between the first and second intrinsic parameters to produce a normalized second image; and filling a first set of one or more holes of the occlusion mask based on the normalized second image to produce a modified first image.
-
公开(公告)号:US11704766B2
公开(公告)日:2023-07-18
申请号:US17979630
申请日:2022-11-02
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Marc-Andre Chenier , Yan Cote , Yves Millette
CPC classification number: G06T1/20 , G06T5/003 , G06T5/007 , G06T7/73 , G06T15/005 , G06T15/20 , G06T19/006
Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.
-
公开(公告)号:US11496723B1
公开(公告)日:2022-11-08
申请号:US16581074
申请日:2019-09-24
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Yan Cote
IPC: H04N13/275 , G06T19/00 , H04N13/349 , H04N13/282 , H04N13/383
Abstract: Generating a representation of a scene includes detecting an indication to capture sensor data to generate a virtual representation of a scene in a physical environment at a first time, in response to the indication obtaining first sensor data from a first capture device at the first time, obtaining second sensor data from a second capture device at the first time, and combining the first sensor data and the second sensor data to generate the virtual representation of the scene.
-
-
-
-
-
-
-
-