公开(公告)号：US12209902B1

公开(公告)日：2025-01-28

申请号：US18238712

申请日：2023-08-28

Applicant: Apple Inc.

Inventor： Arun Srivatsan Rangaprasad ,  Anselm Grundhoefer

IPC: G01J1/42

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a type of environment based on light assessment. For example, an example process may include obtaining a first set of light data from a first sensor (e.g., a multiwavelength ambient light sensor) in a physical environment that includes a light source. The first set of light data may identify diffuse light in each of multiple light wavelength ranges that is received by the first sensor. The process may further include obtaining a second set of data from the second sensor in the physical environment. The process may further include determining, based on the first set of light data and the second set of data, that the physical environment is a first type of environment (e.g., indoor) or a second type of environment (e.g., outdoor) based on a set of criteria (e.g., artificial light vs. sunlight).

公开(公告)号：US11977951B1

公开(公告)日：2024-05-07

申请号：US18213034

申请日：2023-06-22

Applicant: Apple Inc.

Inventor： Jean-Charles Bernard Marcel Bazin ,  Anselm Grundhoefer ,  Arun Srivatsan Rangaprasad

IPC: G06K7/10 ,  G06K7/14

CPC classification number: G06K7/10722 ,  G06K7/1417

Abstract: Various implementations disclosed herein include devices, systems, and methods that match image portions of a first set of image portions and image portions of another set of image portions. This may be performed in a such a way that the sum of descriptor distances of the matched image portions is optimized in a globally optimal way. In some implementations, the matching is subject to one or more constraints, e.g., ensuring that each image portion of the first data set is matched with at least one image portion of the second data set and ensuring that each image portion of the second data set is matched with only one image portion of the first data set.

公开(公告)号：US11961290B1

公开(公告)日：2024-04-16

申请号：US16902528

申请日：2020-06-16

Applicant: Apple Inc.

Inventor： Anselm Grundhoefer ,  Pedro Manuel Da Silva Quelhas ,  Phillip N. Smith ,  Omar Elafifi ,  Eshan Verma ,  Daniele Casaburo

IPC: G06V20/20 ,  A61B5/00 ,  A61B5/0205 ,  A61B5/024 ,  A61B5/08 ,  A61B5/11 ,  A61B5/16 ,  G06F3/147

CPC classification number: G06V20/20 ,  A61B5/0077 ,  A61B5/02055 ,  A61B5/1124 ,  A61B5/163 ,  A61B5/444 ,  A61B5/4803 ,  A61B5/4833 ,  A61B5/6803 ,  A61B5/7445 ,  G06F3/147 ,  A61B5/024 ,  A61B5/0816 ,  A61B5/082

Abstract: In one implementation, a method of remedying a medical impairment of a user is performed by a device including a processor, non-transitory memory, one or more biometric sensors, an image sensor, and a display. The method includes detecting, based on data from at least one of the image sensor and the one or more biometric sensors, a medical impairment of a user of the head-mounted device from a plurality of potential medical impairments associated with a plurality of remedies. The method includes selecting, from the plurality of remedies, a remedy of the medical impairment of the user. The method includes controlling the display to effect the remedy of the medical impairment of the user.

公开(公告)号：US11955099B2

公开(公告)日：2024-04-09

申请号：US18099436

申请日：2023-01-20

Applicant: Apple Inc.

Inventor： Arun Srivatsan Rangaprasad ,  Anselm Grundhoefer

IPC: G09G5/02 ,  G06V10/60

CPC classification number: G09G5/02 ,  G06V10/60 ,  G09G2360/144

Abstract: Various implementations disclosed herein include methods, electronic devices, and systems for performing perceptual-based color correction based on chromaticity values. To that end, in some implementations, a method is performed at an electronic device with one or more processors, a non-transitory memory, and a see-through display. The method includes determining a chromaticity value associated with ambient light from a physical environment. The chromaticity value quantifies the ambient light. The method includes determining a set of color correction values based on a function of the chromaticity value and image data. The set of color correction values and the chromaticity value together satisfy one or more perceptual criteria. The method includes modifying the image data in order to generate display data based on a function of the set of color correction values. The method includes displaying the display data on the see-through display.

公开(公告)号：US11935503B1

公开(公告)日：2024-03-19

申请号：US17225366

申请日：2021-04-08

Applicant: Apple Inc.

Inventor： Sivalogeswaran Ratnasingam ,  Anselm Grundhoefer ,  Ralf Habel

IPC: G09G5/10

CPC classification number: G09G5/10 ,  G09G2320/0646 ,  G09G2354/00 ,  G09G2360/141 ,  G09G2360/144

Abstract: A method includes sensing a plurality of luminance values associated with ambient light from a physical environment. The plurality of luminance values quantifies the ambient light arriving at a see-through display. The method includes obtaining a plurality of semantic values respectively associated with a plurality of portions within image data. The plurality of portions includes a first portion of the image data and a second portion of the image data. The method includes identifying a first one of the plurality of semantic values that satisfies a criterion. The first one of the plurality of semantic values is associated with the first portion of the image data. The method includes mapping, based on a function of a portion of the plurality of luminance values, the image data to predetermined display characteristics of the first portion of the image data within a performance threshold.

公开(公告)号：US11915097B1

公开(公告)日：2024-02-27

申请号：US17143411

申请日：2021-01-07

Applicant: Apple Inc.

Inventor： Mohamed Selim Ben Himane ,  Anselm Grundhoefer ,  Arun Srivatsan Rangaprasad ,  Jeffrey S. Norris ,  Paul Ewers ,  Scott G. Wade ,  Thomas G. Salter ,  Tom Sengelaub

IPC: G06K9/18 ,  G06K7/14 ,  G06T7/90 ,  G06N20/00

CPC classification number: G06K7/1443 ,  G06K7/1417 ,  G06K7/1456 ,  G06N20/00 ,  G06T7/90

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide color visual markers that include colored markings that encode data, where the colors of the colored markings are determined by scanning (e.g., detecting the visual marker using a sensor of an electronic device) the visual marker itself. In some implementations, a visual marker is detected in an image of a physical environment. In some implementations, the visual marker is detected in the image by detecting a predefined shape of a first portion of the visual marker in the image. Then, a color-interpretation scheme is determined for interpreting colored markings of the visual marker that encode data by identifying a set of colors at a corresponding set of predetermined locations on the visual marker. Then, the data of the visual marker is decoded using the colored markings and the set of colors of the color-interpretation scheme.

公开(公告)号：US11892632B2

公开(公告)日：2024-02-06

申请号：US17028043

申请日：2020-09-22

Applicant: Apple Inc.

Inventor： Anselm Grundhoefer ,  Michael J. Rockwell

IPC: G02B27/01 ,  G06F3/14

CPC classification number: G02B27/0172 ,  G06F3/1407 ,  G02B2027/014 ,  G02B2027/0112

Abstract: A method includes sensing a plurality of light superposition characteristic values associated with ambient light from a physical environment. The ambient light emanates from the physical environment towards one side of a translucent display. The plurality of light superposition characteristic values quantifies interactions with the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on a function of the plurality of light superposition characteristic values and predetermined display characteristics of a computer-generated reality (CGR) object. The method includes changing one or more display operating parameters associated with the electronic device in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the CGR object within a performance threshold.

公开(公告)号：US20230298541A1

公开(公告)日：2023-09-21

申请号：US18099436

申请日：2023-01-20

Applicant: Apple Inc.

Inventor： Arun Srivatsan Rangaprasad ,  Anselm Grundhoefer

IPC: G09G5/02 ,  G06V10/60

CPC classification number: G09G5/02 ,  G06V10/60 ,  G09G2360/144

Abstract: Various implementations disclosed herein include methods, electronic devices, and systems for performing perceptual-based color correction based on chromaticity values. To that end, in some implementations, a method is performed at an electronic device with one or more processors, a non-transitory memory, and a see-through display. The method includes determining a chromaticity value associated with ambient light from a physical environment. The chromaticity value quantifies the ambient light. The method includes determining a set of color correction values based on a function of the chromaticity value and image data. The set of color correction values and the chromaticity value together satisfy one or more perceptual criteria. The method includes modifying the image data in order to generate display data based on a function of the set of color correction values. The method includes displaying the display data on the see-through display.

公开(公告)号：US20220391608A1

公开(公告)日：2022-12-08

申请号：US17824339

申请日：2022-05-25

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Anselm Grundhoefer ,  Tushar Gupta

IPC: G06K7/14 ,  G06T7/70 ,  G06V40/18 ,  G02B27/01

Abstract: Various implementations disclosed herein include devices, systems, and methods that use a marking on a transparent surface (e.g., a prescription lens insert for an HMD) to identify information (e.g., prescription parameters) about the transparent surface. In some implementations, the markings do not interfere with eye tracking through the transparent surface or using the transparent surface to view virtual content or a physical environment. In some implementations, image data is obtained from an image sensor of an electronic device, the image data corresponding to a transparent surface attached to the electronic device. Then, a code is identified in the image data, wherein the code is detectable on the transparent surface by the image sensor without interfering with a function of the electronic device involving the transparent surface. In some implementations, content is provided at the electronic device based on the identified code, wherein the content is viewable through the transparent surface.

公开(公告)号：US20220319128A1

公开(公告)日：2022-10-06

申请号：US17711119

申请日：2022-04-01

Applicant: Apple Inc.

Inventor： Jean-Charles Bernard Marcel Bazin ,  Anselm Grundhoefer ,  Bart Trzynadlowski ,  Thomas J. Moore

IPC: G06T19/00 ,  G06T7/70 ,  G06T15/00

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide XR in which virtual objects are positioned based on the accuracy of localizing an electronic device in a physical environment. In some implementations, the technique assesses the accuracy of localization (e.g., centimeter-level accuracy, room-level accuracy, and building-level accuracy) and dynamically adjusts a display strategy. In some implementations, the technique determines a condition causing inaccuracy (e.g., a semantic condition such as “too fast”, “too far”, “too dark”), and provides a notification (e.g., “too fast-slow down”, “too far-move closer”, “too dark-turn on a light”) at the electronic device based on the condition causing the inaccuracy in the localization.