-
公开(公告)号:US11823339B2
公开(公告)日:2023-11-21
申请号:US17711119
申请日:2022-04-01
Applicant: Apple Inc.
Inventor: Jean-Charles Bernard Marcel Bazin , Anselm Grundhoefer , Bart Trzynadlowski , Thomas J. Moore
CPC classification number: G06T19/006 , G06T7/70 , G06T15/00 , G06T2207/20081 , G06T2207/30244
Abstract: Various implementations disclosed herein include devices, systems, and methods that provide XR in which virtual objects are positioned based on the accuracy of localizing an electronic device in a physical environment. In some implementations, the technique assesses the accuracy of localization (e.g., centimeter-level accuracy, room-level accuracy, and building-level accuracy) and dynamically adjusts a display strategy. In some implementations, the technique determines a condition causing inaccuracy (e.g., a semantic condition such as “too fast”, “too far”, “too dark”), and provides a notification (e.g., “too fast-slow down”, “too far-move closer”, “too dark-turn on a light”) at the electronic device based on the condition causing the inaccuracy in the localization.
-
公开(公告)号:US11792507B1
公开(公告)日:2023-10-17
申请号:US17150832
申请日:2021-01-15
Applicant: Apple Inc.
Inventor: Paolo Di Febbo , Chaminda N. Vidanagamachchi , Yohan Rajan , Anselm Grundhoefer
IPC: H04N23/65 , G06V10/82 , G06V20/52 , H04N7/18 , G08B13/196 , H04N23/45 , H04N23/61 , H04N23/667 , G06V10/22 , G06V10/147 , G06V10/10 , G06V20/58
CPC classification number: H04N23/651 , G06V10/82 , G06V20/52 , G08B13/19643 , H04N7/188 , H04N23/45 , H04N23/61 , H04N23/667 , G06V10/147 , G06V10/16 , G06V10/22 , G06V20/58
Abstract: An apparatus includes a primary camera sensor configured to capture images having a first resolution, a primary processing circuit configured to process images captured by the primary camera sensor, a secondary camera sensor configured to capture images having a second resolution, and a secondary processing circuit configured to process images captured by the secondary camera sensor. In response to a determination that a particular object of interest is included in a particular image, the secondary processing circuit may be further configured to cause the primary processing circuit and the primary camera sensor to exit a reduced power mode. The primary camera sensor may be further configured, in response to the exiting, to capture a different image. The primary processing circuit may also be configured to process the different image to validate the particular object of interest.
-
公开(公告)号:US11785176B1
公开(公告)日:2023-10-10
申请号:US17173525
申请日:2021-02-11
Applicant: Apple Inc.
Inventor: Arun Srivatsan Rangaprasad , Anselm Grundhoefer
CPC classification number: H04N5/58 , G01J1/4204 , H04N23/70
Abstract: Various implementations disclosed herein include devices, systems, and methods that estimate a location of a light source based on ambient light data. For example, an example process may include acquiring ambient light data from an ambient light sensor (ALS) during movement of a device in a physical environment, acquiring motion data from a motion sensor during the movement of the device, determining, based on the ambient light data and the motion data, estimates of three-dimensional (3D) locations of a light source with respect to the device during the movement of the device, and tracking a location of the device in a 3D coordinate system during the movement of the device based on the estimates of the 3D locations of the light source with respect to the device during the movement of the device.
-
公开(公告)号:US11776503B2
公开(公告)日:2023-10-03
申请号:US17223512
申请日:2021-04-06
Applicant: Apple Inc.
Inventor: Sivalogeswaran Ratnasingam , Anselm Grundhoefer , Ralf Habel
IPC: G09G5/02
CPC classification number: G09G5/02 , G09G2320/0233 , G09G2320/0666 , G09G2360/144
Abstract: A method includes sensing a plurality of luminance values associated with ambient light from a physical environment. The plurality of luminance values quantifies the ambient light arriving at a see-through display. The method includes identifying respective portions of the plurality of luminance values, across the see-through display, based on corresponding portions of rendered image data. The method includes modifying one or more of the respective portions of the plurality of luminance values based on a function of predetermined display characteristics associated with the rendered image data, in order to generate one or more modified portions of the plurality of luminance values. The method includes modifying the corresponding portions of the rendered image data in order to generate display data, based on the one or more modified portions of the plurality of luminance values. The method includes displaying, on the see-through display, the display data.
-
公开(公告)号:US20230267860A1
公开(公告)日:2023-08-24
申请号:US18011065
申请日:2021-06-07
Applicant: Apple Inc.
Inventor: Ralf Habel , Shuang Wang , Yue Ma , Sivalogeswaran Ratnasingam , Anselm Grundhoefer
IPC: G09G3/00
CPC classification number: G09G3/001 , G09G2320/0242 , G09G2360/144
Abstract: In accordance with some implementations, a method is performed at an electronic device with one or more processors, a non-transitory memory, and a see-through display. The method includes determining a plurality of light superposition characteristic values associated with ambient light from a physical environment. The plurality of light superposition characteristic values quantifies the ambient light. The method includes modifying image data in order to generate modified image data, based on a function of the plurality of light superposition characteristic values and a reference perceptual gamut. The method includes transforming the modified image data into display data based on a function of a portion of the plurality of light superposition characteristic values and a reference physical gamut that is associated with the see-through display. The method includes displaying the display data on the see-through display.
-
公开(公告)号:US11734527B1
公开(公告)日:2023-08-22
申请号:US17355658
申请日:2021-06-23
Applicant: Apple Inc.
CPC classification number: G06K7/10722 , G06K7/1417
Abstract: Various implementations disclosed herein include devices, systems, and methods that match image portions of a first set of image portions and image portions of another set of image portions. This may be performed in a such a way that the sum of descriptor distances of the matched image portions is optimized in a globally optimal way. In some implementations, the matching is subject to one or more constraints, e.g., ensuring that each image portion of the first data set is matched with at least one image portion of the second data set and ensuring that each image portion of the second data set is matched with only one image portion of the first data set.
-
公开(公告)号:US11710310B2
公开(公告)日:2023-07-25
申请号:US16881691
申请日:2020-05-22
Applicant: Apple Inc.
Inventor: Anselm Grundhoefer , Rahul Nair
CPC classification number: G06V20/20 , G02B27/0172 , G06F3/017 , G06T7/579 , G06V40/107 , G06V40/28
Abstract: Various implementations disclosed herein include devices, systems, and methods that use an object as a background for virtual content. Some implementations involve obtaining an image of a physical environment. A location of a surface of an object is detected based on the image. A virtual content location to display virtual content is determined, where the virtual content location corresponds to the location of the surface of the object. Then, a view of the physical environment and virtual content displayed at the virtual content location is provided.
-
公开(公告)号:US11545108B2
公开(公告)日:2023-01-03
申请号:US17158402
申请日:2021-01-26
Applicant: Apple Inc.
Inventor: Siddharth Shankar Hazra , Ralf Habel , Anselm Grundhoefer , Aleksandr M. Movshovich , Moinul Khan , Marwan Hussein
Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.
-
公开(公告)号:US20220261085A1
公开(公告)日:2022-08-18
申请号:US17668868
申请日:2022-02-10
Applicant: Apple Inc.
Inventor: Jean-Charles Bernard Marcel Bazin , Anselm Grundhoefer , Ivan Kolesov
Abstract: Various implementations disclosed herein include devices, systems, and methods that provide measurement techniques for electronic devices such as optical see-through head mounted devices. In some implementations, a line of sight technique is used to identify a 3D position of a measurement point to enable measurement of an object in a 3D environment. In some implementations, different measurement point identification techniques are automatically selected and used to identify a 3D position of a measurement point to enable measurement of an object in a 3D environment. In some implementations, a 3D position of a measurement point is identified to enable measurement of an object in a 3D environment, where the measurement point is identified by selecting from multiple candidates that are determined using different measurement point selection techniques.
-
公开(公告)号:US20220189433A1
公开(公告)日:2022-06-16
申请号:US17687088
申请日:2022-03-04
Applicant: APPLE INC.
Inventor: Anselm Grundhoefer , Geoffrey Grant Stahl
Abstract: In one implementation, a method includes: displaying a UI element as an overlay in a UI associated with a first FOV, wherein the first FOV is characterized by a first viewing vector of a physical environment; detecting a change from the first FOV to a second FOV, wherein the second FOV is characterized by a second viewing vector of the physical environment; and in response to detecting the change from the first FOV to the second FOV, determining a prominence-display value for the UI element; if the prominence-display value for the UI element exceeds a prominence threshold, displaying the UI element as the overlay in the UI associated with the second FOV; and if the prominence-display value for the UI element does not exceed the prominence threshold, ceasing display of the UI element in the UI associated with the second FOV.
-
-
-
-
-
-
-
-
-