公开(公告)号：WO2008033830A3

公开(公告)日：2008-03-20

申请号：PCT/US2007/078148

申请日：2007-09-11

Applicant: APPLE INC. ,  NORMILE, Jim ,  PUN, Thomas ,  SHI, Xiaojin ,  TONG, Xin ,  WU, Hsi-jung

Inventor： NORMILE, Jim ,  PUN, Thomas ,  SHI, Xiaojin ,  TONG, Xin ,  WU, Hsi-jung

IPC: H04N7/26

Abstract: Techniques for encoding data based at least in part upon an awareness of the decoding complexity of the encoded data and the ability of a target decoder to decode the encoded data are disclosed. In some embodiments, a set of data is encoded based at least in part upon a state of a target decoder to which the encoded set of data is to be provided. In some embodiments, a set of data is encoded based at least in part upon the states of multiple decoders to which the encoded set of data is to be provided.

公开(公告)号：WO2015183410A1

公开(公告)日：2015-12-03

申请号：PCT/US2015/024168

申请日：2015-04-02

Applicant: APPLE INC.

Inventor： NORMILE, James, O. ,  WU, Hsi-jung ,  ZHOU, Xiaosong ,  CHUNG, Chris, Y. ,  ZHANG, Ke ,  SU, Yeping

IPC: H04N21/231 ,  H04L29/08

CPC classification number: H04N21/433 ,  H04L65/4084 ,  H04L67/1078 ,  H04L67/108 ,  H04N21/231 ,  H04N21/25891 ,  H04N21/26258 ,  H04N21/432 ,  H04N21/437 ,  H04N21/6587 ,  H04N21/812 ,  H04N21/8456 ,  H04N21/85406

Abstract: A method and system for caching and streaming media content, including predictively delivering and/or acquiring content is provided. In the system, client devices may be communicatively coupled in a network, and may access and share cached content. Video segments making up a media stream may be selectively delivered to the clients such that a complete media stream may be formed from the different segments delivered to the different clients. Video segments may be pushed by the server to the client or requested by the client according to a prioritization scheme, including downloading: partial items on a client's subscription log, lower quality version(s) of content before higher quality version(s), higher bitrate segments before lower bitrate segments, summaries of full-length content, advertisements and splash screens common to multiple video clips.

Abstract translation: 提供了一种用于缓存和流式传输媒体内容的方法和系统，包括预测地传递和/或获取内容。 在系统中，客户机设备可以通信地耦合在网络中，并且可以访问和共享缓存的内容。 构成媒体流的视频片段可以被选择性地传递到客户端，使得可以从递送到不同客户端的不同片段形成完整的媒体流。 视频片段可以由服务器推送到客户端或由客户端根据优先化方案请求，包括下载：客户端订阅日志上的部分项目，较高质量版本之前的较低质量版本的内容，更高质量版本 低比特率段之间的比特率段，多个视频剪辑共有的全长内容，广告和闪屏的总结。

公开(公告)号：WO2008049052A2

公开(公告)日：2008-04-24

申请号：PCT/US2007/081758

申请日：2007-10-18

Applicant: APPLE INC. ,  HASKELL, Barin Geoffry ,  WU, Hsi-jung ,  SHI, Xiaojin

Inventor： WU, Hsi-jung ,  SHI, Xiaojin

IPC: H04N7/36 ,  H04N7/26

CPC classification number: H04N19/59 ,  H04N19/44 ,  H04N19/51 ,  H04N19/80

Abstract: A first improvement is described for prediction of motion vectors to be used in prediction of video data for enhancement layer data. Arbitrary pixelblock partitioning between base layer data and enhancement layer data raises problems to identify base layer motion vectors to be used as prediction sources for enhancement layer motion vectors. The disclosed method develops enhancement layer motion vectors by scaling a base layer pixelblock partition map according to a size difference between the base layer video image and the enhancement layer video image, then identified scale base layer pixelblocks that are co-located with the enhancement layer pixelblocks for which motion vector prediction is to be performed. Motion vectors from the scaled co-located base layer pixelblocks are averaged, weighted according to a degree of overlap between the base layer pixelblocks and the enhancement layer pixelblock. Another improvement is obtained by filtering recovered base layer image data before being provided to an enhancement layer decoder. When a specified filter requires image data outside a prediction region available from a base layer decoder, the prediction region data may be supplemented with previously-decoded data from an enhancement layer at a border of the prediction region.

Abstract translation: 描述了用于预测用于增强层数据的视频数据的预测中的运动矢量的第一改进。 基层数据和增强层数据之间的任意像素块划分提出了一些问题，用于识别要用作增强层运动矢量的预测源的基本层运动矢量。 所公开的方法通过根据基本层视频图像和增强层视频图像之间的尺寸差来缩放基本层像素块分割图来开发增强层运动矢量，然后识别与增强层像素块共同定位的比例基底层像素块 进行运动矢量预测。 根据基层像素块和增强层像素块之间的重叠程度对来自缩放的同位置的基本层像素块的运动矢量进行平均化。 通过在提供给增强层解码器之前对恢复的基层图像数据进行滤波来获得另一改进。 当指定的滤波器需要从基本层解码器可用的预测区域之外的图像数据时，可以从预测区域的边界处的增强层补充预先解码的数据。

公开(公告)号：EP3008911B1

公开(公告)日：2020-11-04

申请号：EP14744241.2

申请日：2014-07-03

Applicant: Apple Inc.

Inventor： BIDERMAN, David, L. ,  ZHOU, Xiaosong ,  PRICE, Douglas, Scott ,  SU, Yeping ,  CHUNG, Chris, Y. ,  WU, Hsi-jung ,  LI, Zhenheng ,  SU, John ,  BATSON, James, D.

IPC: H04N21/4402 ,  H04N21/6587

公开(公告)号：EP2294823A2

公开(公告)日：2011-03-16

申请号：EP09759310.7

申请日：2009-06-03

Applicant: APPLE INC.

Inventor： SHI, Xiaojin ,  WU, Hsi-jung

IPC: H04N7/26 ,  H04N7/50

CPC classification number: H04N19/86 ,  H04N19/103 ,  H04N19/127 ,  H04N19/154 ,  H04N19/156 ,  H04N19/164 ,  H04N19/174 ,  H04N19/176 ,  H04N19/196 ,  H04N19/436 ,  H04N19/46 ,  H04N19/463 ,  H04N19/61

Abstract: Embodiments of the present invention provide apparatuses and methods of coding video. The apparatuses and methods may further provide coding a source video sequence according to a block-based coding process, estimating processing capabilities of a target decoder, determining if the estimated processing capabilities are sufficient to perform deblocking filtering. If not sufficient, the apparatuses and methods may provide computing deblocking filter strengths for pixel blocks of the source video sequence to be used at decoding, and transmitting the deblocking filter strengths in a coded video data signal with the coded video data. Moreover, if not sufficient, the apparatuses and methods may provide changing coding parameters including, but not limited to, block sizes, transform sizes, and Qmatrix.

Abstract translation: 本发明的实施例提供了编码视频的设备和方法。 所述装置和方法还可以提供根据基于块的编码过程对源视频序列进行编码，估计目标解码器的处理能力，确定所估计的处理能力是否足以执行解块滤波。 如果不足够，则这些装置和方法可以为将在解码时使用的源视频序列的像素块提供计算解块滤波器强度，并且将编码视频数据信号中的解块滤波器强度与编码视频数据一起发送。 此外，如果不充分，则装置和方法可以提供改变的编码参数，包括但不限于块大小，变换大小和Qmatrix。

公开(公告)号：EP2077038B1

公开(公告)日：2013-01-30

申请号：EP07844389.2

申请日：2007-10-18

Applicant: APPLE INC.

Inventor： WU, Hsi-jung ,  SHI, Xiaojin ,  HASKELL, Barin Geoffrey

IPC: H04N7/26 ,  H04N7/36 ,  H04N7/46

CPC classification number: H04N19/59 ,  H04N19/44 ,  H04N19/51 ,  H04N19/80

公开(公告)号：WO2014051860A1

公开(公告)日：2014-04-03

申请号：PCT/US2013/054152

申请日：2013-08-08

Applicant: APPLE INC.

Inventor： ZHANG, Dazhong ,  ZHOU, Xiaosong ,  WU, Hsi-jung

IPC: H04N7/36 ,  H04N7/26

CPC classification number: H04N19/68 ,  H04N19/103 ,  H04N19/109 ,  H04N19/13 ,  H04N19/166 ,  H04N19/172 ,  H04N19/174 ,  H04N19/57 ,  H04N19/573 ,  H04N19/58 ,  H04N19/65 ,  H04N19/91

Abstract: Coding techniques for input video may include assigning picture identifiers to input frames in either long-form or short-form formats. If a network error has occurred that results in loss of previously-coded video data, a new input frame may be assigned a picture identifier that is coded in a long-form coding format. If no network error has occurred, the input frame may be assigned a picture identifier that is coded in a short-form coding format. Long-form coding may mitigate against loss of synchronization between an encoder and a decoder by picture identifiers.

Abstract translation: 用于输入视频的编码技术可以包括将图像标识符分配给长格式或短格式格式的输入帧。 如果发生导致先前编码的视频数据丢失的网络错误，则可以为新的输入帧分配以长格式编码格式编码的图像标识符。 如果没有发生网络错误，则可以为输入帧分配以短格式编码格式编码的图像标识符。 长格式编码可以通过图像标识符减轻编码器和解码器之间的同步丢失。

公开(公告)号：WO2013006455A1

公开(公告)日：2013-01-10

申请号：PCT/US2012/044994

申请日：2012-06-29

Applicant: APPLE INC. ,  ZHOU, Xiaosong ,  WU, Hsi-jung ,  LIN, Yao-chung

Inventor： ZHOU, Xiaosong ,  WU, Hsi-jung ,  LIN, Yao-chung

IPC: H04N7/26 ,  H04N7/36 ,  H04N7/50

CPC classification number: H04N19/58 ,  H04N19/105 ,  H04N19/109 ,  H04N19/139 ,  H04N19/172 ,  H04N19/197 ,  H04N19/46 ,  H04N19/61

Abstract: In a video coding/decoding system, reference picture caches in a video coder and decoder may be partitioned dynamically based on camera and background motion can lead to improved coding efficiency and coding quality. When a camera is fixed and therefore exhibits low motion, a system may allocate larger portions of the reference picture cache to storage of long term reference frames. In this case, foreground elements of an image (for example, a person) may move in front of a relatively fixed background. Increasing the number of long term reference frames can increase the chances that, no matter where the foreground elements are within a frame currently being coded, the reference picture cache will contain at least one frame that provides an adequate prediction match to background elements within the new frame. Thus the background elements uncovered in the current frame can be coded at high quality with a low number of bits. When a camera exhibits high motion, the system may allocate larger portions of the reference picture cache to storage of short term reference frames.

Abstract translation: 在视频编码/解码系统中，视频编码器和解码器中的参考图像高速缓存可以基于相机进行动态分割，并且背景运动可以提高编码效率和编码质量。 当照相机固定并因此表现出低运动时，系统可以将较大部分的参考图像高速缓存分配给长期参考帧的存储。 在这种情况下，图像的前景元素（例如，人）可以在相对固定的背景之前移动。 增加长期参考帧的数量可以增加机会，无论前景元素在当前正被编码的帧内的何处，参考图像高速缓存将包含至少一个帧，其提供与新的背景元素内的足够的预测匹配 帧。 因此，当前帧中未覆盖的背景元素可以以低位数的高质量被编码。 当相机呈现高运动时，系统可以将较大部分的参考图像高速缓存分配给短期参考帧的存储。

公开(公告)号：WO2009149151A2

公开(公告)日：2009-12-10

申请号：PCT/US2009/046079

申请日：2009-06-03

Applicant: APPLE INC. ,  SHI, Xiaojin ,  WU, Hsi-jung

Inventor： SHI, Xiaojin ,  WU, Hsi-jung

IPC: H04N7/26 ,  H04N7/50

CPC classification number: H04N19/86 ,  H04N19/103 ,  H04N19/127 ,  H04N19/154 ,  H04N19/156 ,  H04N19/164 ,  H04N19/174 ,  H04N19/176 ,  H04N19/196 ,  H04N19/436 ,  H04N19/46 ,  H04N19/463 ,  H04N19/61

Abstract: Embodiments of the present invention provide apparatuses and methods of coding video. The apparatuses and methods may further provide coding a source video sequence according to a block-based coding process, estimating processing capabilities of a target decoder, determining if the estimated processing capabilities are sufficient to perform deblocking filtering. If not sufficient, the apparatuses and methods may provide computing deblocking filter strengths for pixel blocks of the source video sequence to be used at decoding, and transmitting the deblocking filter strengths in a coded video data signal with the coded video data. Moreover, if not sufficient, the apparatuses and methods may provide changing coding parameters including, but not limited to, block sizes, transform sizes, and Qmatrix.

Abstract translation: 本发明的实施例提供了对视频进行编码的装置和方法。 装置和方法可以进一步提供根据基于块的编码处理对源视频序列进行编码，估计目标解码器的处理能力，确定所估计的处理能力是否足以执行去块滤波。 如果不足够，则设备和方法可以为解码时要使用的源视频序列的像素块提供计算解块滤波器强度，并将编码的视频数据信号中的解块滤波器强度传送到编码的视频数据。 此外，如果不足够，则设备和方法可以提供改变的编码参数，包括但不限于块大小，变换大小和Qmatrix。

公开(公告)号：EP3008911A1

公开(公告)日：2016-04-20

申请号：EP14744241.2

申请日：2014-07-03

Applicant: Apple Inc.

Inventor： BIDERMAN, David, L. ,  ZHOU, Xiaosong ,  PRICE, Douglas, Scott ,  SU, Yeping ,  CHUNG, Chris, Y. ,  WU, Hsi-jung ,  LI, Zhenheng ,  SU, John ,  BATSON, James, D.

IPC: H04N21/4402 ,  H04N21/6587

Abstract: System and methods for improved playback of a video stream are presented. Video snippets are identified that include a number of consecutive frames for playback. Snippets may be evenly temporally spaced in the video stream or may be content adaptive. Then the first frame of a snippet may be selected as the first frame of a scene or other appropriate stopping point. Scene detection, object detection, motion detection, video metadata, or other information generated during encoding or decoding of the video stream may aid in appropriate snippet selection.

Abstract translation: 介绍了改进视频流播放的系统和方法。 识别出包括多个连续帧进行播放的视频片段。 片段可以在视频流中均匀地间隔开，或者可以是内容自适应的。 然后，片段的第一帧可以被选择为场景或其他适当停止点的第一帧。 视频流的编码或解码过程中产生的场景检测，对象检测，运动检测，视频元数据或其他信息可能有助于适当的片段选择。