Cache architecture for image warp processing systems and methods

    公开(公告)号:US12141893B2

    公开(公告)日:2024-11-12

    申请号:US17933409

    申请日:2022-09-19

    Applicant: Apple Inc.

    Abstract: A device may include a display for displaying an image frame based on warped image data and image processing circuitry to generate the warped image data by warping input image data to account for one or more distortions associated with displaying the image. The image processing circuitry may include a two-stage cache architecture having an first cache and an second cache and warp the input image data by generating mapping data indicative of a warp between the input image space and the output image space and fetching the input image data to populate the first cache. Warping may also include populating the second cache with a grouping of pixel values from the first cache that are selected according to a sliding window that traverses the first cache based on the mapping data and interpolating between pixel values of the grouping to generate pixel values of the warped image data.

    Hierarchical grid interpolation systems and methods

    公开(公告)号:US12106444B2

    公开(公告)日:2024-10-01

    申请号:US17356216

    申请日:2021-06-23

    Applicant: Apple Inc.

    CPC classification number: G06T3/18 G06T3/04 G06T3/4007

    Abstract: An electronic device may include an electronic display to display an image based on processed image data. The electronic device may also include image processing circuitry to determine a hierarchical grid having multiple grid points divided into grid partitions. A first set of grid points associated with a first set of grid partitions may include a first set of mappings to corresponding coordinates of input image data in a source frame. The image processing circuitry may also interpolate between the first set of grid points to determine a second set of grid points of having a second set of mappings to corresponding coordinates of the input image data based on the first set of mappings. The image processing circuitry may also generate the processed image data by applying the first set of mappings and the second set of mappings to the input image data.

    Curvature interpolation for lookup table

    公开(公告)号:US11682364B2

    公开(公告)日:2023-06-20

    申请号:US17494344

    申请日:2021-10-05

    Applicant: Apple Inc.

    Inventor: Jian Zhou

    CPC classification number: G09G5/06

    Abstract: An electronic device includes an electronic display configured to present an image based on image data and a display pipeline having image processing circuitry to process the image data for display on the electronic display by receiving the image data, referencing a lookup table (LUT) to determine output values based on a plurality of input value sets associated with the image data, the LUT including entries respectively mapping an output value to a defined input value set, determining whether an input value set of the plurality of input value sets is represented by the entries of the LUT, performing curvature interpolation to determine an interpolated output value associated with the input value set in response to determining the input value set of the image data is not represented by the entries of the LUT, and applying the interpolated output value to the input value set to generate updated image data.

    Error concealment for a head-mountable device

    公开(公告)号:US11276143B2

    公开(公告)日:2022-03-15

    申请号:US17114796

    申请日:2020-12-08

    Applicant: Apple Inc.

    Abstract: In various implementations, a method includes obtaining a first frame that is characterized by a first resolution associated with a first memory allocation. In some implementations, the method includes down-converting the first frame from the first resolution to a second resolution that is lower than the first resolution initially defining the first frame in order to produce a reference frame. In some implementations, the second resolution is associated with a second memory allocation that is less than a target memory allocation derived from the first memory allocation. In some implementations, the method includes storing the reference frame in a non-transitory memory. In some implementations, the method includes obtaining a second frame that is characterized by the first resolution. In some implementations, the method includes performing an error correction operation on the second frame based on the reference frame stored in the non-transitory memory.

    CURVATURE INTERPOLATION FOR LOOKUP TABLE

    公开(公告)号:US20220068236A1

    公开(公告)日:2022-03-03

    申请号:US17494344

    申请日:2021-10-05

    Applicant: Apple Inc.

    Inventor: Jian Zhou

    Abstract: An electronic device includes an electronic display configured to present an image based on image data and a display pipeline having image processing circuitry to process the image data for display on the electronic display by receiving the image data, referencing a lookup table (LUT) to determine output values based on a plurality of input value sets associated with the image data, the LUT including entries respectively mapping an output value to a defined input value set, determining whether an input value set of the plurality of input value sets is represented by the entries of the LUT, performing curvature interpolation to determine an interpolated output value associated with the input value set in response to determining the input value set of the image data is not represented by the entries of the LUT, and applying the interpolated output value to the input value set to generate updated image data.

    ERROR CONCEALMENT FOR A HEAD-MOUNTABLE DEVICE

    公开(公告)号:US20210118090A1

    公开(公告)日:2021-04-22

    申请号:US17114796

    申请日:2020-12-08

    Applicant: Apple Inc.

    Abstract: In various implementations, a method includes obtaining a first frame that is characterized by a first resolution associated with a first memory allocation. In some implementations, the method includes down-converting the first frame from the first resolution to a second resolution that is lower than the first resolution initially defining the first frame in order to produce a reference frame. In some implementations, the second resolution is associated with a second memory allocation that is less than a target memory allocation derived from the first memory allocation. In some implementations, the method includes storing the reference frame in a non-transitory memory. In some implementations, the method includes obtaining a second frame that is characterized by the first resolution. In some implementations, the method includes performing an error correction operation on the second frame based on the reference frame stored in the non-transitory memory.

    Error concealment for a head-mountable device

    公开(公告)号:US10891714B2

    公开(公告)日:2021-01-12

    申请号:US16681631

    申请日:2019-11-12

    Applicant: Apple Inc.

    Abstract: In various implementations, a method includes obtaining a first frame that is characterized by a first resolution associated with a first memory allocation. In some implementations, the method includes down-converting the first frame from the first resolution to a second resolution that is lower than the first resolution initially defining the first frame in order to produce a reference frame. In some implementations, the second resolution is associated with a second memory allocation that is less than a target memory allocation derived from the first memory allocation. In some implementations, the method includes storing the reference frame in a non-transitory memory. In some implementations, the method includes obtaining a second frame that is characterized by the first resolution. In some implementations, the method includes performing an error correction operation on the second frame based on the reference frame stored in the non-transitory memory.

    CACHE ARCHITECTURE FOR IMAGE WARP PROCESSING SYSTEMS AND METHODS

    公开(公告)号:US20240095871A1

    公开(公告)日:2024-03-21

    申请号:US17933409

    申请日:2022-09-19

    Applicant: Apple Inc.

    CPC classification number: G06T1/60 G06T1/20

    Abstract: A device may include a display for displaying an image frame based on warped image data and image processing circuitry to generate the warped image data by warping input image data to account for one or more distortions associated with displaying the image. The image processing circuitry may include a two-stage cache architecture having an first cache and an second cache and warp the input image data by generating mapping data indicative of a warp between the input image space and the output image space and fetching the input image data to populate the first cache. Warping may also include populating the second cache with a grouping of pixel values from the first cache that are selected according to a sliding window that traverses the first cache based on the mapping data and interpolating between pixel values of the grouping to generate pixel values of the warped image data.

    Point-of-View Image Warp Systems and Methods

    公开(公告)号:US20220414841A1

    公开(公告)日:2022-12-29

    申请号:US17356223

    申请日:2021-06-23

    Applicant: Apple Inc.

    Abstract: An electronic device may include an electronic display to display an image based on processed image data. The electronic device may also include image processing circuitry to generate the processed image data. The image processing circuitry may receive input image data corresponding to an image in a first perspective and warp the input image data from the first perspective to a second perspective, generating warped image data. Additionally, the image processing circuitry may determine one or more occluded regions in the second perspective and determine fill-data corresponding to the occluded regions. The processed image data may be generated by combining the warped image data and the fill-data.

    USE OF PIPELINED HIERARCHICAL MOTION ESTIMATOR IN VIDEO CODING
    10.
    发明申请
    USE OF PIPELINED HIERARCHICAL MOTION ESTIMATOR IN VIDEO CODING 审中-公开
    管道分层运动估计器在视频编码中的应用

    公开(公告)号:US20150341659A1

    公开(公告)日:2015-11-26

    申请号:US14696162

    申请日:2015-04-24

    Applicant: Apple Inc.

    CPC classification number: H04N19/577 H04N19/105 H04N19/53

    Abstract: A pipelined video coding system may include a motion estimation stage and an encoding stage. The motion estimation stage may operate on an input frame of video data in a first stage of operation and may generate estimates of motion and other statistical analyses. The encoding stage may operate on the input frame of video data in a second stage of operation later than the first stage. The encoding stage may perform predictive coding using coding parameters that are selected, at least in part, from the estimated motion and statistical analysis generated by the motion estimator. Because the motion estimation is performed at a processing stage that precedes the encoding, a greater amount of processing time may be devoted to such processes than in systems that performed both operations in a single processing stage.

    Abstract translation: 流水线视频编码系统可以包括运动估计级和编码级。 运动估计阶段可以在第一操作阶段中对视频数据的输入帧进行操作,并且可以产生运动和其他统计分析的估计。 编码级可以在晚于第一级的第二操作阶段中对视频数据的输入帧进行操作。 编码阶段可以使用至少部分地由运动估计器生成的估计运动和统计分析来选择的编码参数来执行预测编码。 因为在编码之前的处理阶段执行运动估计,所以与在单个处理阶段中执行两个操作的系统相比,可以将更多的处理时间用于这样的处理。

Patent Agency Ranking