IMAGE-BASED DETECTION OF SURFACES THAT PROVIDE SPECULAR REFLECTIONS AND REFLECTION MODIFICATION

    公开(公告)号:US20210064910A1

    公开(公告)日:2021-03-04

    申请号:US17001788

    申请日:2020-08-25

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that detect surfaces and reflections in such surfaces. Some implementations involve providing a CGR environment that includes virtual content that replaces the appearance of a user or the user's device in a mirror or other surface providing a reflection. For example, a CGR environment may be modified to include a reflection of the user that does not include the device that the user is holding or wearing. In another example, the CGR environment is modified so that virtual content, such as a newer version of the electronic device or a virtual wand, replaces the electronic device in the reflection. In another example, the CGR environment is modified so that virtual content, such as a user avatar, replaces the user in the reflection.

    TRACKING AND DRIFT CORRECTION
    13.
    发明申请

    公开(公告)号:US20200089313A1

    公开(公告)日:2020-03-19

    申请号:US16567970

    申请日:2019-09-11

    Applicant: APPLE INC.

    Abstract: Some implementations provide improved user interfaces for interacting with a virtual environment. The virtual environment is presented by a display of a first device having an image sensor. The first device uses the image sensor to determine a relative position and orientation of a second device based on a marker displayed on a display of the second device. The first device uses the determined relative position of the second device to display a representation of the second device including virtual content in place of the marker.

    Method of providing image feature descriptors

    公开(公告)号:US10192145B2

    公开(公告)日:2019-01-29

    申请号:US15444404

    申请日:2017-02-28

    Applicant: Apple Inc.

    Abstract: A method of providing a set of feature descriptors configured to be used in matching an object in an image of a camera is provided. The method includes: a) providing at least two images of a first object; b) extracting in at least two of the images at least one feature from the respective image, c) providing at least one descriptor for an extracted feature, and storing the descriptors; d) matching descriptors in the first set of descriptors; e) computing a score parameter based on the result of the matching process; f) selecting at least one descriptor based on its score parameter; g) adding the selected descriptor(s) to a second set of descriptors; and h) updating the score parameter of descriptors in the first set based on a selection process and to the result of the matching process.

    VISUAL MARKER
    15.
    发明申请

    公开(公告)号:US20240403590A1

    公开(公告)日:2024-12-05

    申请号:US18802129

    申请日:2024-08-13

    Applicant: APPLE INC.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that provide a visual marker including a plurality of markings arranged in a corresponding plurality of shapes. In some implementations, each marking is formed of a set of sub-markings separated by gaps and arranged according to a respective shape, and the gaps of the plurality of markings are configured to encode data and indicate orientation of the visual marker. In some implementations, the plurality of markings are arranged in a plurality of concentric rings of increasing size. In some implementations, the orientation is encoded in a first set of gaps and data in a second set of gaps of the gaps in the plurality of markings.

    TRACKING AND DRIFT CORRECTION
    16.
    发明公开

    公开(公告)号:US20240281055A1

    公开(公告)日:2024-08-22

    申请号:US18654595

    申请日:2024-05-03

    Applicant: APPLE INC.

    Abstract: Some implementations provide improved user interfaces for interacting with a virtual environment. The virtual environment is presented by a display of a first device having an image sensor. The first device uses the image sensor to determine a relative position and orientation of a second device based on a marker displayed on a display of the second device. The first device uses the determined relative position of the second device to display a representation of the second device including virtual content in place of the marker.

    Partial Perspective Correction with Mitigation of Vertical Disparity

    公开(公告)号:US20240098232A1

    公开(公告)日:2024-03-21

    申请号:US18369621

    申请日:2023-09-18

    Applicant: Apple Inc.

    CPC classification number: H04N13/117 H04N13/383

    Abstract: In one implementation, a method of performing perspective correction is performed by a device having a three-dimensional device coordinate system and including a first image sensor, a first display, one or more processors, and non-transitory memory. The method includes capturing, using the first image sensor, a first image of a physical environment. The method includes transforming the first image from a first perspective of the first image sensor to a second perspective based on a difference between the first perspective and the second perspective, wherein the second perspective is a first distance away from a location corresponding to a first eye of a user less than a second distance between the first perspective and the location corresponding to the first eye of the user. The method includes displaying, on the first display, the transformed first image of the physical environment.

    Localization and mapping using images from multiple devices

    公开(公告)号:US11682138B2

    公开(公告)日:2023-06-20

    申请号:US17524298

    申请日:2021-11-11

    Applicant: Apple Inc.

    CPC classification number: G06T7/75 G06T7/251 G06T19/006

    Abstract: The present disclosure relates generally to localization and mapping. In some examples, an electronic device obtains first image data and motion data using a motion sensor. The electronic device receives information corresponding to a second electronic device. The electronic device generates a representation of a first pose of the first electronic device using the first image data, the motion data, and the information corresponding to the second electronic device. The electronic device displays, on the display, a virtual object, wherein the displaying of the virtual object is based on the representation of the first pose of the first electronic device.

    Temporal filter touch detection
    19.
    发明授权

    公开(公告)号:US11237671B1

    公开(公告)日:2022-02-01

    申请号:US16903564

    申请日:2020-06-17

    Applicant: Apple Inc.

    Abstract: Detecting a touch includes determining, from first raw touch data, an estimated touch type for a first plurality of frames, obtaining second raw touch data comprising a probability that a touch has occurred for each of a second plurality of frames, applying the selected filter to the additional raw data to obtain processed data, and detecting whether a touch has occurred for a particular frame based on the processed data.

    OBJECT DETECTION USING MULTIPLE THREE DIMENSIONAL SCANS

    公开(公告)号:US20210279898A1

    公开(公告)日:2021-09-09

    申请号:US17326559

    申请日:2021-05-21

    Applicant: Apple, Inc.

    Abstract: One exemplary implementation facilitates object detection using multiple scans of an object in different lighting conditions. For example, a first scan of the object can be created by capturing images of the object by moving an image sensor on a first path in a first lighting condition, e.g., bright lighting. A second scan of the object can then be created by capturing additional images of the object by moving the image sensor on a second path in a second lighting condition, e.g., dim lighting. Implementations determine a transform that associates the scan data from these multiple scans to one another and use the transforms to generate a 3D model of the object in a single coordinate system. Augmented content can be positioned relative to that object in the single coordinate system and thus will be displayed in the appropriate location regardless of the lighting condition in which the physical object is later detected.

Patent Agency Ranking