公开(公告)号：US20250063182A1

公开(公告)日：2025-02-20

申请号：US18772408

申请日：2024-07-15

Applicant: APPLE INC.

Inventor： Alexandros TOURAPIS ,  Dimitri PODBORSKI ,  Jungsun KIM ,  Leo BARNES ,  Davide CONCION

IPC: H04N19/30 ,  H04N19/186 ,  H04N19/59

Abstract: Techniques are disclosed for representing video and images with full resolution color component information and yet remain compatible with legacy processing systems that process images with reduced resolution information. The new image representation may include a scalable format that consists of a base layer, coded to match expectations of a legacy coder. The new image representation also may include additional enhancement layer(s) that enable upconversions of reduced-resolution color components to higher resolutions. The image representation not only provides power savings in decoding full-resolution representations but it also provides other benefits, such as scalable and power aware decoding.

公开(公告)号：US20230269400A1

公开(公告)日：2023-08-24

申请号：US18181261

申请日：2023-03-09

Applicant: Apple Inc.

Inventor： Xiaohua YANG ,  Alexandros TOURAPIS ,  Dazhong ZHANG ,  Hang YUAN ,  Hsi-Jung WU ,  Jae Hoon KIM ,  Jiefu ZHAI ,  Ming CHEN ,  Xiaosong ZHOU

IPC: H04N19/90 ,  H04N19/52 ,  H04N19/597 ,  G06F3/01 ,  H04N21/2343

CPC classification number: H04N19/90 ,  H04N19/52 ,  H04N19/597 ,  G06F3/013 ,  H04N21/234345

Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

公开(公告)号：US20230188733A1

公开(公告)日：2023-06-15

申请号：US18168390

申请日：2023-02-13

Applicant: APPLE INC.

Inventor： Alexandros TOURAPIS ,  Athanasios LEONTARIS

IPC: H04N19/176 ,  H04N19/117 ,  H04N19/14 ,  H04N19/86 ,  H04N19/46

CPC classification number: H04N19/176 ,  H04N19/117 ,  H04N19/14 ,  H04N19/86 ,  H04N19/46

Abstract: Video coding schemes may include one or more filters to reduce coding artifacts and improve video quality. These filters may be applied to decode video data in a predetermined sequence. The output from one or more of these filters may be selected for different images, blocks, or sets of video data and then copied and/or routed to a display or a buffer storing reference data that is used to decode other video data in a data stream. Providing the ability to select which filter output is used for display and as a reference may result in better video quality for multiple types of video data. The filters that are selected for display and for reference may be different and may vary for different images, blocks, and data sets.

公开(公告)号：US20250159164A9

公开(公告)日：2025-05-15

申请号：US18056915

申请日：2022-11-18

Applicant: APPLE INC.

Inventor： Alexandros TOURAPIS ,  Yeping SU ,  David SINGER ,  Hsi-Jung WU

IPC: H04N19/124 ,  H04N19/176 ,  H04N19/18 ,  H04N19/60 ,  H04N19/91

Abstract: Video compression and decompression techniques are disclosed that provide improved bandwidth control for video compression and decompression systems. In particular, video coding and decoding techniques quantize input video in multiple dimensions. According to these techniques, pixel residuals may be generated from a comparison of an array of input data to an array of prediction data. The pixel residuals may be quantized in a first dimension. After the quantization, the quantized pixel residuals may be transformed to an array of transform coefficients. The transform coefficients may be quantized in a second dimension and entropy coded. Decoding techniques invert these processes. In still other embodiments, multiple quantizers may be provided upstream of the transform stage, either in parallel or in cascade, which provide greater flexibility to video coders to quantize data in different dimensions in an effort to balance the competing interest in compression efficiency and quality of reconstructed video.

公开(公告)号：US20240397119A1

公开(公告)日：2024-11-28

申请号：US18797415

申请日：2024-08-07

Applicant: Apple Inc.

Inventor： Xiaohua YANG ,  Alexandros TOURAPIS ,  Dazhong ZHANG ,  Hang YUAN ,  Hsi-Jung WU ,  Jae Hoon KIM ,  Jiefu ZHAI ,  Ming CHEN ,  Xiaosong ZHOU

IPC: H04N19/90 ,  G06F3/01 ,  H04N19/52 ,  H04N19/597 ,  H04N21/2343

Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

公开(公告)号：US20240196019A1

公开(公告)日：2024-06-13

申请号：US18486634

申请日：2023-10-13

Applicant: APPLE INC.

Inventor： Leo BARNES ,  Davide CONCION ,  Alexandros TOURAPIS

IPC: H04N19/70 ,  H04N19/182

CPC classification number: H04N19/70 ,  H04N19/182

Abstract: Improved image coding techniques for high-bit depth images includes deriving two or more separate lower-bit-depth main and extension images from one high-bit-depth source image, and then encoding them separately as lower-bit-depth images. At a decoder, the separate main and extension images are decoded, and then combined to create a single reconstructed source image. The improved techniques may use lossless or lossy codecs, and may provide some backward compatibility with legacy decoders.

公开(公告)号：US20240179336A1

公开(公告)日：2024-05-30

申请号：US18059013

申请日：2022-11-28

Applicant: Apple Inc.

Inventor： Leo BARNES ,  Alexandros TOURAPIS

IPC: H04N19/51 ,  H04N19/167 ,  H04N19/30

CPC classification number: H04N19/51 ,  H04N19/167 ,  H04N19/30

Abstract: Improved still image encoding techniques may include generating first items of a log and second items of coded tile-layer image data, where the log enumerates coding quality levels contained in the second items. The second items may include independent-type items, derived-type items of identity variant, and derived-type items with other variant(s). Such encoding techniques may provide for progressive decoding of images, and may provide for spatially variable encoding quality levels.

公开(公告)号：US20230300341A1

公开(公告)日：2023-09-21

申请号：US18157360

申请日：2023-01-20

Applicant: APPLE INC.

Inventor： Yeqing WU ,  Yunfei ZHENG ,  Alexandros TOURAPIS ,  Alican NALCI ,  Yixin DU ,  Hilmi Enes EGILMEZ ,  Albert E. KEINATH ,  Jun XIN ,  Hsi-Jung WU

IPC: H04N19/139 ,  H04N19/176

CPC classification number: H04N19/139 ,  H04N19/176

Abstract: Techniques are disclosed for generating virtual reference frames that may be used for prediction of input video frames. The virtual reference frames may be derived from already-coded reference frames and thereby incur reduced signaling overhead. Moreover, signaling of virtual reference frames may be avoided until an encoder selects the virtual reference frame as a prediction reference for a current frame. In this manner, the techniques proposed herein contribute to improved coding efficiencies.

公开(公告)号：US20230142771A1

公开(公告)日：2023-05-11

申请号：US17979025

申请日：2022-11-02

Applicant: Apple Inc.

Inventor： Yixin DU ,  Alexandros TOURAPIS ,  Yunfei ZHENG ,  Jun XIN ,  Mukta S. Gore ,  Alican NALCI ,  Mei T. GUO ,  Yeqing WU ,  Hsi-Jung WU

IPC: H04N19/82 ,  H04N19/132 ,  H04N19/186 ,  H04N19/176

CPC classification number: H04N19/82 ,  H04N19/132 ,  H04N19/186 ,  H04N19/176

Abstract: A filtering system for video coders and decoders is disclosed that includes a feature detector having an input for samples reconstructed from coded video data representing a color component of source video, and having an output for data identifying a feature recognized therefrom, an offset calculator having an input for the feature identification data from the feature detector and having an output for a filter offset, and a filter having an input for the filter offset from the offset calculator and an input for the reconstructed samples, and having an output for filtered samples. The filtering system is expected to improve operations of video coder/decoder filtering systems by selecting filtering offsets from analysis of recovered video data in a common color plane as the samples that will be filtered.

公开(公告)号：US20150245004A1

公开(公告)日：2015-08-27

申请号：US14502373

申请日：2014-09-30

Applicant: Apple Inc.

Inventor： Haitao GUO ,  Kenneth I. GREENEBAUM ,  Guy COTE ,  David W. SINGER ,  Alexandros TOURAPIS

IPC: H04N11/20 ,  H04N5/46

CPC classification number: H04N5/46 ,  G09G5/006 ,  G09G5/026 ,  G09G5/363 ,  G09G2340/06 ,  H04N21/42202 ,  H04N21/4223 ,  H04N21/42653 ,  H04N21/431 ,  H04N21/44008 ,  H04N21/4402 ,  H04N21/44218 ,  H04N21/4532 ,  H04N21/4854

Abstract: A method and system for adaptively mixing video components with graphics/UI components, where the video components and graphics/UI components may be of different types, e.g., different dynamic ranges (such as HDR, SDR) and/or color gamut (such as WCG). The mixing may result in a frame optimized for a display device's color space, ambient conditions, viewing distance and angle, etc., while accounting for characteristics of the received data. The methods include receiving video and graphics/UI elements, converting the video to HDR and/or WCG, performing statistical analysis of received data and any additional applicable rendering information, and assembling a video frame with the received components based on the statistical analysis. The assembled video frame may be matched to a color space and displayed. The video data and graphics/UI data may have or be adjusted to have the same white point and/or primaries.

Abstract translation: 一种用于将视频组件与图形/ UI组件自适应地混合的方法和系统，其中视频组件和图形/ UI组件可以是不同类型的，例如不同的动态范围（例如HDR，SDR）和/或色域（诸如 WCG）。 混合可能导致针对显示设备的颜色空间，环境条件，观看距离和角度等优化的框架，同时考虑接收到的数据的特性。 这些方法包括接收视频和图形/ UI元素，将视频转换为HDR和/或WCG，对所接收的数据和任何附加的可应用的呈现信息进行统计分析，以及基于统计分析与接收的组件组合视频帧。 组合的视频帧可以与颜色空间匹配并显示。 视频数据和图形/ UI数据可以具有或被调整为具有相同的白点和/或初级。