Predictive dimming of optical passthrough displays

    公开(公告)号:US11366321B1

    公开(公告)日:2022-06-21

    申请号:US16851582

    申请日:2020-04-17

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of controlling a dimming level of dimmable optical element based on a predicted ambient light level is performed at a device including one or more processors, non-transitory memory, and a dimmable optical element. The method includes predicting a change, in a first direction, in an ambient light level at a future time. The method includes changing, at a first time in advance of the future time and in the first direction, a transmission coefficient of the dimmable optical element based on the predicted change in the ambient light level. The method includes changing, at a second time after the first time and in a second direction opposite the first direction, the transmission coefficient of the dimmable optical element based on the ambient light level at the second time.

    Application programming interface for setting the prominence of user interface elements

    公开(公告)号:US11302285B1

    公开(公告)日:2022-04-12

    申请号:US16839033

    申请日:2020-04-02

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of determining a visual appearance of a user interface (UI) element overlaid in an underlying physical environment is performed at a device. The method includes: obtaining environmental data corresponding to a physical environment; determining environmental characteristics of the physical environment based on the environmental data; in response to obtaining a request to display a UI element, determining whether a prominence-display value satisfies a prominence criterion; in response to determining that the prominence-display value satisfies the prominence criterion: modifying visual characteristics of the UI element based on the environmental characteristics of the physical environment, and displaying the UI element as an overlay on the physical environment, wherein the UI element includes the modified visual characteristics; and in response to determining that the prominence-display value for the UI element does not satisfy the prominence criterion, foregoing modifying the visual characteristics of the UI element.

    LOCATION AWARE VISUAL MARKERS
    43.
    发明申请

    公开(公告)号:US20210097714A1

    公开(公告)日:2021-04-01

    申请号:US17032227

    申请日:2020-09-25

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that determine the relative positioning (e.g., offset) between a mobile electronic device and a visual marker. In some implementations, the determined relative positioning and a known position of the visual marker are used to determine a position (e.g., geo coordinates) of the mobile electronic device that is more accurate than existing techniques. In some implementations, the determined relative positioning is used with a position of the mobile electronic device to crowd source the stored position of the visual marker. In some implementations, the determined relative positioning and a position of the visual marker are used to determine a position of an object detected in an image by the mobile electronic device. In some implementations at an electronic device having a processor, locally-determined locations of a visual marker are received from mobile electronic devices that scan a visual marker.

    Optimal Luminance Mapping for Augmented Reality Devices

    公开(公告)号:US20210090342A1

    公开(公告)日:2021-03-25

    申请号:US17018059

    申请日:2020-09-11

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein adjust the luminance values of an image to improve the appearance of the image on an augmented reality device. In some implementations, the luminance values of an image are adjusted so that the image can be displayed on an augmented reality device (e.g., with background luminance) such that the image will be perceived more similarly to how the image would be perceived otherwise (e.g., on a device without background luminance). In some implementations, an image is adjusted based on an estimate of human perception of luminance that is not linear.

    Attention-driven rendering for computer-generated objects

    公开(公告)号:US12277623B2

    公开(公告)日:2025-04-15

    申请号:US18122818

    申请日:2023-03-17

    Applicant: APPLE INC.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that are capable of adjusting the appearance of computer-generated objects (e.g., augmentations) that are predicted to be outside the current focus of an optical-see-through HMD user's attention. In some implementations, a method includes displaying a first computer-generated object and a second computer-generated object on an optical-see-though display of a HMD. In some implementations, the first computer-generated object is identified based on a prediction that the attention of a user is directed to the first computer-generated object, and an appearance of the second computer-generated object is adjusted to change from a first state to a second state.

    ENVIRONMENT-MODELING BASED CAMERA ADAPTATION FOR PASSTHROUGH EXTENDED REALITY SYSTEMS

    公开(公告)号:US20250111589A1

    公开(公告)日:2025-04-03

    申请号:US18826434

    申请日:2024-09-06

    Applicant: Apple Inc.

    Abstract: Various implementations provide passthrough video based on adjusting camera parameters based on environment modeling. An environment characteristic may be determined based on modeling the physical environment based on sensor data captured via one or more sensors. For example, this may involve determining environment light source optical characteristics, environment surfaces optical characteristics, a 3D mapping of the environment, user behavior, a prediction of optical characteristics of light coming in the camera, and the like. The method may involve, based on the environment characteristic, determining a camera parameter for an image captured via the image sensor. For example, the method may determine exposure, gain, tone mapping, color balance, noise reduction, sharpness enhancement. The method may determine the camera parameter based on user information, e.g., user preferences, user activity, etc. The method may involve providing passthrough video of the physical environment based on the determined camera parameter.

    Ambient light sensor-based localization

    公开(公告)号:US12133016B1

    公开(公告)日:2024-10-29

    申请号:US18242606

    申请日:2023-09-06

    Applicant: Apple Inc.

    CPC classification number: H04N5/58 G01J1/4204 H04N23/70

    Abstract: Various implementations disclosed herein include devices, systems, and methods that estimate a location of a light source based on ambient light data. For example, an example process may include acquiring ambient light data from an ambient light sensor (ALS) during movement of a device in a physical environment, acquiring motion data from a motion sensor during the movement of the device, determining, based on the ambient light data and the motion data, estimates of three-dimensional (3D) locations of a light source with respect to the device during the movement of the device, and tracking a location of the device in a 3D coordinate system during the movement of the device based on the estimates of the 3D locations of the light source with respect to the device during the movement of the device.

    Visual marker
    49.
    发明授权

    公开(公告)号:US12093763B2

    公开(公告)日:2024-09-17

    申请号:US18010578

    申请日:2021-06-15

    Applicant: APPLE INC.

    CPC classification number: G06K19/06168

    Abstract: Various implementations disclosed herein include devices, systems, and methods that provide a visual marker including a plurality of markings arranged in a corresponding plurality of shapes. In some implementations, each marking is formed of a set of sub-markings separated by gaps and arranged according to a respective shape, and the gaps of the plurality of markings are configured to encode data and indicate orientation of the visual marker. In some implementations, the plurality of markings are arranged in a plurality of concentric rings of increasing size. In some implementations, the orientation is encoded in a first set of gaps and data in a second set of gaps of the gaps in the plurality of markings.

    MODIFYING DISPLAY OPERATING PARAMETERS BASED ON LIGHT SUPERPOSITION FROM A PHYSICAL ENVIRONMENT

    公开(公告)号:US20240111162A1

    公开(公告)日:2024-04-04

    申请号:US18539088

    申请日:2023-12-13

    Applicant: Apple Inc.

    CPC classification number: G02B27/0172 G06F3/1407 G02B2027/0112 G02B2027/014

    Abstract: A method includes sensing a plurality of light superposition characteristic values associated with ambient light from a physical environment. The ambient light emanates from the physical environment towards one side of a translucent display. The plurality of light superposition characteristic values quantifies interactions with the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on a function of the plurality of light superposition characteristic values and predetermined display characteristics of a computer-generated reality (CGR) object. The method includes changing one or more display operating parameters associated with the electronic device in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the CGR object within a performance threshold.

Patent Agency Ranking