Electronic Device Content Provisioning Adjustments based on Wireless Communication Channel Bandwidth Condition

    公开(公告)号:US20250142150A1

    公开(公告)日:2025-05-01

    申请号:US18964961

    申请日:2024-12-02

    Applicant: Apple Inc.

    Abstract: An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.

    Neural network-based image processing with artifact compensation

    公开(公告)号:US11893711B2

    公开(公告)日:2024-02-06

    申请号:US17841387

    申请日:2022-06-15

    Applicant: Apple Inc.

    Abstract: Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.

    Dynamic foveated pipeline
    3.
    发明授权

    公开(公告)号:US11836885B2

    公开(公告)日:2023-12-05

    申请号:US17053181

    申请日:2019-05-06

    Applicant: Apple Inc.

    CPC classification number: G06T3/0093 G06T3/40 G06T9/001

    Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.

    PRIORITY-BASED VIDEO ENCODING AND TRANSMISSION

    公开(公告)号:US20230092305A1

    公开(公告)日:2023-03-23

    申请号:US18052807

    申请日:2022-11-04

    Applicant: Apple Inc.

    Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder that encodes the blocks and passes the encoded blocks to a wireless interface that packetizes the blocks for transmittal over a wireless connection. The encoder may categorize the encoded frequency bands into multiple priority levels, and may tag each frequency block with metadata indicating the frequency band represented in the block, the priority of the frequency band, and timing information. The wireless interface may then transmit or drop packets according to the priority levels of the encoded frequency blocks in the packets and/or according to the timing information of the frequency blocks in the packets.

    Rate control for low latency video encoding and transmission

    公开(公告)号:US11451788B2

    公开(公告)日:2022-09-20

    申请号:US17252701

    申请日:2019-06-27

    Applicant: Apple Inc.

    Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands for a slice of a frame may be buffered so that complexity statistics may be calculated across the frequency bands prior to encoding. The statistics may then be used by a rate control component in determining quantization parameters for the frequency bands for modulating the rate in the encoder for the current slice. The quantization parameters for the frequency bands may be calculated jointly to optimize the quality of the displayed frames after decoder reconstruction and wavelet synthesis on a receiving device. Information about one or more previously processed frames may be used in combination with the statistics for a current slice in determining the quantization parameters for the current slice.

    PRIORITY-BASED VIDEO ENCODING AND TRANSMISSION

    公开(公告)号:US20210274200A1

    公开(公告)日:2021-09-02

    申请号:US17252697

    申请日:2019-06-27

    Applicant: Apple Inc.

    Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder that encodes the blocks and passes the encoded blocks to a wireless interface that packetizes the blocks for transmittal over a wireless connection. The encoder may categorize the encoded frequency bands into multiple priority levels, and may tag each frequency block with metadata indicating the frequency band represented in the block, the priority of the frequency band, and timing information. The wireless interface may then transmit or drop packets according to the priority levels of the encoded frequency blocks in the packets and/or according to the timing information of the frequency blocks in the packets.

    CHROMINANCE AND LUMINANCE ENHANCING SYSTEMS AND METHODS

    公开(公告)号:US20200043138A1

    公开(公告)日:2020-02-06

    申请号:US16053342

    申请日:2018-08-02

    Applicant: Apple Inc.

    Abstract: An electronic device may include enhancement circuitry to enhance high resolution image data to improve perceived quality of an image corresponding to the high resolution image data. The enhancement circuitry may include tone detection circuitry to determine one or more tones within the image and apply changes to the high resolution image data based on the one or more tones. The enhancement circuitry may also include example-based improvement circuitry to compare the high resolution image data to low resolution image data and apply changes to the high resolution image data based on differences between sections of the high resolution image data and sections of the low resolution image data. The enhancement circuitry may also include channel processing circuitry to apply the first and second changes to one or more channels of the high resolution image data.

    Error concealment for a head-mountable device

    公开(公告)号:US10521881B1

    公开(公告)日:2019-12-31

    申请号:US16015788

    申请日:2018-06-22

    Applicant: Apple Inc.

    Abstract: In various implementations, a method includes obtaining a first frame that is characterized by a first resolution associated with a first memory allocation. In some implementations, the method includes down-converting the first frame from the first resolution to a second resolution that is lower than the first resolution initially defining the first frame in order to produce a reference frame. In some implementations, the second resolution is associated with a second memory allocation that is less than a target memory allocation derived from the first memory allocation. In some implementations, the method includes storing the reference frame in a non-transitory memory. In some implementations, the method includes obtaining a second frame that is characterized by the first resolution. In some implementations, the method includes performing an error correction operation on the second frame based on the reference frame stored in the non-transitory memory.

Patent Agency Ranking