公开(公告)号：WO2005027526A1

公开(公告)日：2005-03-24

申请号：PCT/US2004/015032

申请日：2004-05-13

Applicant: APPLE COMPUTER, INC.

Inventor： HASKELL, Barin, Geoffry ,  DUMITRAS, Adriana ,  PURI, Atul

IPC: H04N7/26

CPC classification number: H04N19/87 ,  H04N19/114 ,  H04N19/142 ,  H04N19/147 ,  H04N19/177

Abstract: Methods for processing a set of successive video frames in two passes to determine the number of bidirectional (B) and unidirectional (P) motion to be encoded in a video coding system. During the first pass, motion vectors and motion costs are computed for each frame and a derived cost value is computed based on the motion cost of at least one frame. The derived cost value is used determine the number (N g ) of B-frames to be encoded in the set of successive frames. In the second pass, the set of successive frames are encoded where N B) frames are encoded as B-frames and some or all motion vectors computed in the first pass are reused in the second pass. A scene cut detection method is also provided where an impulse-like increase in a ration of motion costs is monitored

Abstract translation: 用于在两遍中处理一组连续视频帧以确定要在视频编码系统中编码的双向（B）和单向（P）运动的数量的方法。 在第一遍期间，针对每个帧计算运动矢量和运动成本，并且基于至少一帧的运动成本来计算导出成本值。 使用导出成本值确定要在该组连续帧中编码的B帧的数量（Ng）。 在第二遍中，连续帧的集合被编码，其中NB）帧被编码为B帧，并且在第一遍中计算的一些或全部运动矢量在第二遍中重新使用。 还提供场景切断检测方法，其中监视运动成本比例的脉冲状增加

公开(公告)号：WO2005084035A2

公开(公告)日：2005-09-09

申请号：PCT/US2005/000067

申请日：2005-01-05

Applicant: APPLE COMPUTER, INC.

Inventor： PURI, Atul ,  HASKELL, Barin, Geoffry ,  DUMITRAS, Adriana ,  NORMILE, James ,  WU, Hsi-Jung ,  NIE, Xiaochun

IPC: H04N7/26

CPC classification number: H04N19/87 ,  H04N19/124 ,  H04N19/142 ,  H04N19/149 ,  H04N19/152 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176

Abstract: A rate control system is disclosed for video coding applications. The rate controller assigns a quantization parameter for video data in a picture in response to complexity indicators indicative of spatial complexity, motion complexity and/or bits per pel of the picture. A virtual buffer based quantizer parameter is proposed based on a virtual buffer fullness analysis and a target rate estimate, which is derived from the complexity indicators. A second quantizer parameter is proposed from a linear regression analysis of quantizer parameters used to code previously coded pictures of similar type (e.g., I pictures, P pictures or B pictures). A coding policy decision unit defines a final quantizer parameter from a comparison of the two proposed quantizer parameters.

Abstract translation: 公开了一种用于视频编码应用的速率控制系统。 速率控制器响应于指示图像的空间复杂性，运动复杂度和/或每像素的复杂度指示符，为图像中的视频数据分配量化参数。 基于虚拟缓冲区丰满度分析和目标速率估计提出了一种基于虚拟缓冲器的量化器参数，其从复杂度指标中得出。 从用于对相似类型（例如，I图像，P图像或B图像）的先前编码的图像进行编码的量化器参数的线性回归分析提出了第二量化参数。 编码策略决定单元根据两个提出的量化器参数的比较来定义最终的量化器参数。

公开(公告)号：WO2004008654A1

公开(公告)日：2004-01-22

申请号：PCT/US2003/021714

申请日：2003-07-11

Applicant: APPLE COMPUTER, INC.

Inventor： HASKELL, Barin, G. ,  SINGER, David, W. ,  DUMITRAS, Adriana ,  PURI, Atul

IPC: H04B1/66

CPC classification number: H04N19/513 ,  G06T9/005 ,  H04N19/13 ,  H04N19/132 ,  H04N19/176 ,  H04N19/40 ,  H04N19/43 ,  H04N19/44 ,  H04N19/46 ,  H04N19/503 ,  H04N19/51 ,  H04N19/577 ,  H04N19/587 ,  H04N19/61 ,  H04N19/91 ,  H04N21/4305

Abstract: A method and apparatus for variable accuracy inter-picture timing specification for digital video encoding is disclosed. Specificallly the present invention discloses a system that allows the relative timing of nearby video pictures to be encoded in a very efficient manner. In one embodiment, the display time difference between a current video picture (105) and a nearby video picture is determined. The display time difference is then encoded (180) into a digital representation of the video picture. In a preferred embodiment, the nearby video picture is the most recently transmitted stored picture. For coding efficiency, the display time difference may be encoded using a variable length coding system or arithmetic coding. In an alternate embodiment, the display time difference is encoded as a power of two to reduce the number of bits transmitted.

Abstract translation: 公开了一种用于数字视频编码的可变精度图片间定时规范的方法和设备。 特别地，本发明公开了一种允许以非常有效的方式编码附近视频图片的相对定时的系统。 在一个实施例中，确定当前视频图片（105）与附近视频图片之间的显示时间差。 然后将显示时间差编码（180）成视频图像的数字表示。 在优选实施例中，附近的视频图片是最近发送的存储图片。 为了编码效率，可以使用可变长度编码系统或算术编码对显示时间差进行编码。 在一个替代实施例中，显示时间差被编码为2的幂以减少传输的比特数。

公开(公告)号：WO2004064414A2

公开(公告)日：2004-07-29

申请号：PCT/US2004/000316

申请日：2004-01-07

Applicant: APPLE COMPUTER, INC. ,  DUMITRAS, Adriana ,  HASKELL, Barin, G. ,  PURI, Atul

Inventor： DUMITRAS, Adriana ,  HASKELL, Barin, G. ,  PURI, Atul

IPC: H04Q

CPC classification number: H04N19/154 ,  H04N19/00 ,  H04N19/103 ,  H04N19/105 ,  H04N19/147 ,  H04N19/176 ,  H04N19/19 ,  H04N19/52 ,  H04N19/61

Abstract: In this disclosure, a novel method for direct mode enhancement in B-pictures and skip mode enhancement in P-pictures in the framework of H.264 (MPEG-4/Part 10) is disclosed. Direct mode and skip mode enhancements are achieved by clustering the values of the Lagrangian, removing outliers and specifying smaller values of the Lagrangian multiplier in the rate-distortion optimization for encoding mode selection. Experimental results using high quality video sequences show that bit rate reduction is obtained using the method of the present invention, at the expense of a slight loss in peak signal-to-noise ratio (PSNR). By conducting two different experiments, it has been verified that no subjective visual loss is visible despite the peak signal-to-noise ratio change. In relationship to the existing rate­distortion optimization methods currently employed in the (non-normative) MPEG­4/Part 10 encoder, the method of the present invention represents a simple and useful add-on. More importantly, when other solutions such as further increasing the values of the quantization parameter are not applicable, as inadmissible artifacts would be introduced in the decoded pictures, the method of the present invention achieves bit rate reduction without introducing visible distortion in the decoded sequences. Even more, despite the fact that the present document makes use of the H.264 framework, the proposed method is applicable in any video encoding system that employs rate­distortion optimization for encoding mode selection.

Abstract translation: 在本公开中，公开了一种用于H.264（MPEG-4 / Part 10）的框架中的P图像中的B图像和跳过模式增强中的直接模式增强的新颖方法。 直接模式和跳过模式增强是通过对拉格朗日数值进行聚类来实现的，该值是在编码模式选择的速率失真优化中去除异常值并指定较小的拉格朗日乘数值。 使用高质量视频序列的实验结果表明，使用本发明的方法可以以峰值信噪比（PSNR）的轻微损失为代价来获得比特率降低。 通过进行两个不同的实验，已经证实，尽管峰值信噪比变化，没有主观视觉损失是可见的。 与目前在（非规范）MPEG4 / Part 10编码器中使用的现有额定优化方法有关，本发明的方法代表了一种简单有用的附加组件。 更为重要的是，当进一步增加量化参数值的其他解决方案不适用时，由于不可接受的伪像将被引入到解码图像中，所以本发明的方法实现比特率降低而不引入解码序列中的可见失真。 更重要的是，尽管本文件使用了H.264框架，但是所提出的方法可应用于采用额定优化来进行编码模式选择的任何视频编码系统。

公开(公告)号：EP1584200A2

公开(公告)日：2005-10-12

申请号：EP04700631.7

申请日：2004-01-07

Applicant: APPLE COMPUTER, INC.

Inventor： DUMITRAS, Adriana ,  HASKELL, Barin, G. ,  PURI, Atul

IPC: H04Q1/00

CPC classification number: H04N19/154 ,  H04N19/00 ,  H04N19/103 ,  H04N19/105 ,  H04N19/147 ,  H04N19/176 ,  H04N19/19 ,  H04N19/52 ,  H04N19/61

Abstract: In this disclosure, a novel method for direct mode enhancement in B-pictures and skip mode enhancement in P-pictures in the framework of H.264 (MPEG-4/Part 10) is disclosed. Direct mode and skip mode enhancements are achieved by clustering the values of the Lagrangian, removing outliers and specifying smaller values of the Lagrangian multiplier in the rate-distortion optimization for encoding mode selection. Experimental results using high quality video sequences show that bit rate reduction is obtained using the method of the present invention, at the expense of a slight loss in peak signal-to-noise ratio (PSNR). By conducting two different experiments, it has been verified that no subjective visual loss is visible despite the peak signal-to-noise ratio change. In relationship to the existing rate­distortion optimization methods currently employed in the (non-normative) MPEG­4/Part 10 encoder, the method of the present invention represents a simple and useful add-on. More importantly, when other solutions such as further increasing the values of the quantization parameter are not applicable, as inadmissible artifacts would be introduced in the decoded pictures, the method of the present invention achieves bit rate reduction without introducing visible distortion in the decoded sequences. Even more, despite the fact that the present document makes use of the H.264 framework, the proposed method is applicable in any video encoding system that employs rate­distortion optimization for encoding mode selection.

公开(公告)号：EP1563688A1

公开(公告)日：2005-08-17

申请号：EP03778014.5

申请日：2003-10-31

Applicant: APPLE COMPUTER, INC.

Inventor： HASKELL, Barin, G. ,  DUMITRAS, Adriana ,  PURI, Atul

IPC: H04N7/30 ,  H04N7/50

CPC classification number: H04N19/19 ,  H04N19/103 ,  H04N19/147 ,  H04N19/15 ,  H04N19/152 ,  H04N19/17 ,  H04N19/176

Abstract: A Method And Apparatus For Control of Rate-Distortion Tradeoff by Mode Selection in Video Encoders is Disclosed. The system of the present invention first selects a distortion value D near a desired distortion value. Next, the system determines a quantizer value Q using the selected distortion value D. The system then calculates a Lagrange multiplier lambda using the quantizer value Q. Using the selected Lagrange multiplier lambda and quantizer value Q, the system begins encoding pixelblocks. If the system detects a potential buffer overflow, then the system will increase the Lagrange multiplier lambda. If the Lagrange multiplier lambda exceeds a maximum lambda threshold then the system will increase the quantizer value Q. If the system detects a potential buffer underflow, then the system will decrease the Lagrange multiplier lambda. If the Lagrange multiplier lambda falls below a minimum lambda threshold then the system will decrease the quantizer value Q.

公开(公告)号：EP1665801A1

公开(公告)日：2006-06-07

申请号：EP04752135.6

申请日：2004-05-13

Applicant: APPLE COMPUTER, INC.

Inventor： HASKELL, Barin, Geoffry ,  DUMITRAS, Adriana ,  PURI, Atul

IPC: H04N7/26

CPC classification number: H04N19/87 ,  H04N19/114 ,  H04N19/142 ,  H04N19/147 ,  H04N19/177

Abstract: Methods for processing a set of successive video frames in two passes to determine the number of bidirectional (B) and unidirectional (P) motion to be encoded in a video coding system. During the first pass, motion vectors and motion costs are computed for each frame and a derived cost value is computed based on the motion cost of at least one frame. The derived cost value is used determine the number (Ng) of B-frames to be encoded in the set of successive frames. In the second pass, the set of successive frames are encoded where NB) frames are encoded as B-frames and some or all motion vectors computed in the first pass are reused in the second pass. A scene cut detection method is also provided where an impulse-like increase in a ration of motion costs is monitored

公开(公告)号：EP1532746A1

公开(公告)日：2005-05-25

申请号：EP03764499.4

申请日：2003-07-11

Applicant: APPLE COMPUTER, INC.

Inventor： HASKELL, Barin, G. ,  SINGER, David, W. ,  DUMITRAS, Adriana ,  PURI, Atul

IPC: H04B1/66

CPC classification number: H04N19/513 ,  G06T9/005 ,  H04N19/13 ,  H04N19/132 ,  H04N19/176 ,  H04N19/40 ,  H04N19/43 ,  H04N19/44 ,  H04N19/46 ,  H04N19/503 ,  H04N19/51 ,  H04N19/577 ,  H04N19/587 ,  H04N19/61 ,  H04N19/91 ,  H04N21/4305

Abstract: A method and apparatus for variable accuracy inter-picture timing specification for digital video encoding is disclosed. Specificallly the present invention discloses a system that allows the relative timing of nearby video pictures to be encoded in a very efficient manner. In one embodiment, the display time difference between a current video picture (105) and a nearby video picture is determined. The display time difference is then encoded (180) into a digital representation of the video picture. In a preferred embodiment, the nearby video picture is the most recently transmitted stored picture. For coding efficiency, the display time difference may be encoded using a variable length coding system or arithmetic coding. In an alternate embodiment, the display time difference is encoded as a power of two to reduce the number of bits transmitted.

Abstract translation: 一种用于数字视频编码可变精度画面间定时规范的方法和设备游离缺失盘。 具体地说，本发明盘松动的系统确实允许附近的视频画面的相对定时以非常有效的方式进行编码。 在一个，实施例的当前视频图像（105）和附近的视频画面被确定性开采之间的显示时间差。 然后，显示时间差进行编码（180）到视频图象的一个数字表示。 在优选的实施方案中，附近的视频画面是最近反式mitted存储图片。 对于编码效率，显示时间差可以使用可变长度编码系统或算术编码来编码。 在一个替代实施例中，显示时间差被编码为二的幂，以减少比特反式mitted的数目。

公开(公告)号：EP1721467A2

公开(公告)日：2006-11-15

申请号：EP05704910.8

申请日：2005-01-05

Applicant: APPLE COMPUTER, INC.

Inventor： PURI, Atul ,  HASKELL, Barin, Geoffry ,  DUMITRAS, Adriana ,  NORMILE, James ,  WU, Hsi-Jung ,  NIE, Xiaochun

IPC: H04N7/26

CPC classification number: H04N19/87 ,  H04N19/124 ,  H04N19/142 ,  H04N19/149 ,  H04N19/152 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176

Abstract: A rate control system is disclosed for video coding applications. The rate controller assigns a quantization parameter for video data in a picture in response to complexity indicators indicative of spatial complexity, motion complexity and/or bits per pel of the picture. A virtual buffer based quantizer parameter is proposed based on a virtual buffer fullness analysis and a target rate estimate, which is derived from the complexity indicators. A second quantizer parameter is proposed from a linear regression analysis of quantizer parameters used to code previously coded pictures of similar type (e.g., I pictures, P pictures or B pictures). A coding policy decision unit defines a final quantizer parameter from a comparison of the two proposed quantizer parameters.