LOCALIZATION ACCURACY RESPONSE
    12.
    发明公开

    公开(公告)号:US20240037874A1

    公开(公告)日:2024-02-01

    申请号:US18378264

    申请日:2023-10-10

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that provide XR in which virtual objects are positioned based on the accuracy of localizing an electronic device in a physical environment. In some implementations, the technique assesses the accuracy of localization (e.g., centimeter-level accuracy, room-level accuracy, and building-level accuracy) and dynamically adjusts a display strategy. In some implementations, the technique determines a condition causing inaccuracy (e.g., a semantic condition such as “too fast”, “too far”, “too dark”), and provides a notification (e.g., “too fast-slow down”, “too far-move closer”, “too dark-turn on a light”) at the electronic device based on the condition causing the inaccuracy in the localization.

    Colored visual markers for variable use

    公开(公告)号:US11842236B2

    公开(公告)日:2023-12-12

    申请号:US17087723

    申请日:2020-11-03

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that select colors for visual markers that include colored markings encoding data. In some implementations, the colors are automatically or semi-automatically selected. In some implementations, the colors are selected to remain sufficiently detectable despite changes in lighting conditions or printing/display conditions. In some implementations, a set of colors selectable for use in a visual marker is obtained. Then, measures of distance between a plurality of colors of the set of colors is determined, and a subset of the set of colors for the visual marker is selected based on the measure of distance between colors of the subset of colors. In some implementations, the visual marker appearance includes graphical elements encoding data using the subset of colors. In some implementations, input is received using a GUI on a display to determine multiple colors based on a source image.

    MODIFYING RENDERED IMAGE DATA BASED ON AMBIENT LIGHT FROM A PHYSICAL ENVIRONMENT

    公开(公告)号:US20230290321A1

    公开(公告)日:2023-09-14

    申请号:US18101779

    申请日:2023-01-26

    Applicant: Apple Inc.

    CPC classification number: G09G5/10 G02B27/017 G06T19/006

    Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.

    Three-Dimensional Point Selection
    15.
    发明申请

    公开(公告)号:US20240411378A1

    公开(公告)日:2024-12-12

    申请号:US18811072

    申请日:2024-08-21

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that provide point identification techniques for electronic devices such as optical see-through head mounted devices. In some implementations, a line of sight technique is used to identify a 3D position of a point. In some implementations, a touching technique is used to identify a 3D position of a point. In some implementations, different point identification techniques are automatically selected and used to identify a 3D position of a point. In some implementations, a 3D position of a point is associated with user input. In some implementations, a 3D position of a point is identified to determine distances, surface areas, or volumes.

    Robust blur estimation for shapes with known structural elements

    公开(公告)号:US12148198B1

    公开(公告)日:2024-11-19

    申请号:US17719553

    申请日:2022-04-13

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein assess the blurriness of portions of images depicting shapes such as codes or text that have known structural elements. This may involve determining whether a portion of an image of a code or text is sufficiently clear (not blurry) to be accurately interpreted. Blur may be assessed based on spatial frequency of statistical analysis. Blur may be assessed using a machine learning model that is trained using target blur metrics determined based on spatial frequency (e.g., analysis of high frequency portions of discrete cosine transforms of image portions) or statistical analysis (e.g., based on corner/edge detection in image portions).

    Localization accuracy response
    17.
    发明授权

    公开(公告)号:US12118685B2

    公开(公告)日:2024-10-15

    申请号:US18378264

    申请日:2023-10-10

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that provide XR in which virtual objects are positioned based on the accuracy of localizing an electronic device in a physical environment. In some implementations, the technique assesses the accuracy of localization (e.g., centimeter-level accuracy, room-level accuracy, and building-level accuracy) and dynamically adjusts a display strategy. In some implementations, the technique determines a condition causing inaccuracy (e.g., a semantic condition such as “too fast”, “too far”, “too dark”), and provides a notification (e.g., “too fast-slow down”, “too far-move closer”, “too dark-turn on a light”) at the electronic device based on the condition causing the inaccuracy in the localization.

    Detecting specular surfaces
    18.
    发明授权

    公开(公告)号:US12073533B1

    公开(公告)日:2024-08-27

    申请号:US17820442

    申请日:2022-08-17

    Applicant: Apple Inc.

    CPC classification number: G06T3/60 G06V10/60 G06T2207/30244

    Abstract: Identifying a specular surface, such as a mirror, in a captured scene includes extracting, from one or more images of the scene, a set of natural features and generating, from the image, a set of synthesized “mirrored” features. One or more correspondences may be determined between the set of natural features in the image and the set of synthesized mirrored features. A first set of features are identified based on the determined one or more correspondences as representing a specular surface (e.g., a mirror) located in the scene, and then a geometry and/or location of the specular surface within the scene may be determined. For example, in some embodiments, the feature from a determined pair of corresponding features in a scene that is determined to be farther away from the device that captured the image(s) of the scene may be determined to be the feature lying on the specular surface.

    Power efficient object tracking
    20.
    发明授权

    公开(公告)号:US11979657B1

    公开(公告)日:2024-05-07

    申请号:US17402462

    申请日:2021-08-13

    Applicant: Apple Inc.

    CPC classification number: H04N23/65 H04N23/61 H04N23/667 H04N23/695

    Abstract: Implementations of the subject technology provide power efficient object detection for electronic devices. Power efficient object detection can be provided in order to allow extended tracking of objects by portable devices such as battery powered devices. In one or more implementations, a recommendation engine including a machine learning model and/or a rule-based recommendation process may be provided that has been trained to output a sensor recommendation indicating at least one sensor for object tracking. The sensor recommendation can indicate which of several sensors to operate to track a particular object and/or an accuracy level for operating the recommended sensor.

Patent Agency Ranking