-
公开(公告)号:US11693242B2
公开(公告)日:2023-07-04
申请号:US17514082
申请日:2021-10-29
Applicant: Apple Inc.
Inventor: Simon Fortin-Deschênes , Vincent Chapdelaine-Couture , Yan Côté , Anthony Ghannoum
CPC classification number: G02B27/017 , G02B27/0093 , G06T19/006 , G02B2027/014 , G02B2027/0134 , G02B2027/0138 , G02B2027/0187
Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.
-
公开(公告)号:US11790569B2
公开(公告)日:2023-10-17
申请号:US17272251
申请日:2019-09-06
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Sandy J. Carter , Vincent Chapdelaine-Couture , Marc-Andre Chenier , Yan Cote , Simon Fortin-Deschênes , Anthony Ghannoum , Tomlinson Holman , Marc-Olivier Lepage , Yves Millette
IPC: G06T11/00 , G06F3/16 , H04N13/117 , H04N13/156 , H04N13/194 , G02B27/01 , G06F3/01
CPC classification number: G06T11/00 , G02B27/0179 , G06F3/011 , G06F3/165 , H04N13/117 , H04N13/156 , H04N13/194 , G02B2027/0138
Abstract: The present disclosure relates to techniques for inserting imagery from a real environment into a virtual environment. While presenting (e.g., displaying) the virtual environment at an electronic device, a proximity of the electronic device to a physical object located in a real environment is detected. In response to detecting that the proximity of the electronic device to the physical object is less than a first threshold distance, imagery of the physical object is isolated from other imagery of the real environment. The isolated imagery of the physical object is inserted into the virtual environment at a location corresponding to the location of the physical object in the real environment. The imagery of the physical object has a first visibility value associated with the proximity of the electronic device to the physical object.
-
公开(公告)号:US20230059200A1
公开(公告)日:2023-02-23
申请号:US17406817
申请日:2021-08-19
Applicant: Apple Inc.
Inventor: Paolo Di Febbo , Mohamed H. Abu-Rahma , Jelam K. Parekh , Yildiz Sinangil , Mohammad Ghasemzadeh , Anthony Ghannoum , Chaminda N. Vidanagamachchi
Abstract: An apparatus includes an in-memory compute circuit that includes a memory circuit configured to generate a set of products by combining received input values with respective weight values stored in rows of the memory circuit, and to combine the set of products to generate an accumulated output value. The in-memory compute circuit may further include a control circuit and a plurality of routing circuits, including a first routing circuit coupled to a first set of rows of the memory circuit. The control circuit may be configured to cause the first routing circuit to route groups of input values to different ones of the first set of rows over a plurality of clock cycles, and the memory circuit to generate, on a clock cycle following the plurality of clock cycles, a particular accumulated output value that is computed based on the routed groups of input values.
-
公开(公告)号:US12230361B2
公开(公告)日:2025-02-18
申请号:US18346565
申请日:2023-07-03
Applicant: Apple Inc.
Inventor: Paolo Di Febbo , Mohamed H. Abu-Rahma , Jelam K. Parekh , Yildiz Sinangil , Mohammad Ghasemzadeh , Anthony Ghannoum , Chaminda N. Vidanagamachchi
Abstract: An apparatus includes an in-memory compute circuit that includes a memory circuit configured to generate a set of products by combining received input values with respective weight values stored in rows of the memory circuit, and to combine the set of products to generate an accumulated output value. The in-memory compute circuit may further include a control circuit and a plurality of routing circuits, including a first routing circuit coupled to a first set of rows of the memory circuit. The control circuit may be configured to cause the first routing circuit to route groups of input values to different ones of the first set of rows over a plurality of clock cycles, and the memory circuit to generate, on a clock cycle following the plurality of clock cycles, a particular accumulated output value that is computed based on the routed groups of input values.
-
公开(公告)号:US12169276B2
公开(公告)日:2024-12-17
申请号:US18209651
申请日:2023-06-14
Applicant: Apple Inc.
Inventor: Simon Fortin-Deschenes , Vincent Chapdelaine-Couture , Yan Cote , Anthony Ghannoum
Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.
-
公开(公告)号:US11954885B2
公开(公告)日:2024-04-09
申请号:US17476312
申请日:2021-09-15
Applicant: Apple Inc.
Inventor: Paolo Di Febbo , Anthony Ghannoum , Michele Stoppa , Kiranjit Dhaliwal
CPC classification number: G06T7/74 , G06F3/14 , G06T13/00 , H04N23/651 , H04N23/66 , G01S5/02585 , G01S5/16
Abstract: A tracked device may be used in an extended reality system in coordination with a tracking device. The tracked device may be ordinarily difficult to track, for example due to changing appearances or relatively small surface areas of unchanging features, as may be the case with an electronic device with a relatively large display surrounded by a thin physical outer boundary. In these cases, the tracked device may periodically present an image to the tracking device that the tracking device stores as an indication to permit tracking of a known, unchanging feature despite the image not being presented continuously on the display of the tracked device. The image may include a static image, designated tracking data overlaid on an image frame otherwise scheduled for presentation, or extracted image features from the image frame otherwise scheduled for presentation. Additional power saving methods and known marker generation methods are also described.
-
公开(公告)号:US11778154B2
公开(公告)日:2023-10-03
申请号:US16637087
申请日:2018-08-08
Applicant: Apple Inc.
Inventor: Vincent Chapdelaine-Couture , Anthony Ghannoum , Yan Cote , Irving Lustigman , Marc-Andre Chenier , Simon Fortin-Deschenes , Bertrand Nepveu
IPC: G06T19/00 , H04N9/75 , H04N13/344 , H04N5/265
CPC classification number: H04N9/75 , G06T19/006 , H04N5/265 , H04N13/344
Abstract: A Head-Mounted Display with camera sensors to perform chroma keying in a mixed reality context is presented. Low latency is achieved by embedding the processing in the HMD itself, specifically, format camera images, detect the selected color range and make a composite with the virtual content.
-
公开(公告)号:US20230135306A1
公开(公告)日:2023-05-04
申请号:US17518059
申请日:2021-11-03
Applicant: Apple Inc.
Inventor: Paolo Di Febbo , Anthony Ghannoum
Abstract: Embodiments of the present disclosure relate to an unaligned memory access in a neural processor circuit. The neural processor circuit includes a crossbar circuit and a neural engine circuit coupled to the crossbar circuit. During each operating cycle of the neural processor circuit, the crossbar circuit receives a portion of input data, and re-aligns or bypasses the portion of input data. The neural engine circuit receives at least a portion of the re-aligned or bypassed portion of the input data, and performs a convolution operation on the received portion of re-aligned or bypassed portion of input data to generate output data.
-
公开(公告)号:US20250067980A1
公开(公告)日:2025-02-27
申请号:US18946168
申请日:2024-11-13
Applicant: Apple Inc.
Inventor: Simon Fortin-Deschenes , Vincent Chapdelaine-Couture , Yan Cote , Anthony Ghannoum
Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.
-
公开(公告)号:US12135993B2
公开(公告)日:2024-11-05
申请号:US18321919
申请日:2023-05-23
Applicant: Apple Inc.
Inventor: Paolo Di Febbo , Yohan Rajan , Chaminda Nalaka Vidanagamachchi , Anthony Ghannoum
Abstract: In an embodiment, a local memory dedicated to one or more hardware accelerators in a system may include at least two portions: a volatile portion and a non-volatile portion. Data that is reused from iteration to iteration of the hardware accelerator (e.g. constants, instruction words, etc.) may be stored in the non-volatile portion. Data that varies from iteration to iteration may be stored in the volatile portion. Both the local memory and the hardware accelerators may be powered down between iterations, saving power. The non-volatile portion need only be initialized at a first iteration, allowing the amount of time that the hardware accelerators and the local memory are powered up to be lessened for subsequent iterations since the reused data need not be reloaded in the subsequent iterations.
-
-
-
-
-
-
-
-
-