System and method for masking visual compression artifacts in decoded video streams

    公开(公告)号:US09699481B2

    公开(公告)日:2017-07-04

    申请号:US13651181

    申请日:2012-10-12

    Applicant: Apple Inc.

    CPC classification number: H04N19/86

    Abstract: A technique is provided for processing decoded video data to mask visual compression artifacts resulting from video compression. In accordance with this technique, a hardware block is provided for generating and adding random noise to the decoded video stream. In one embodiment, a random number is generated for each pixel of the decoded video data and compared against one or more threshold values to determine a threshold range. In such an embodiment, a noise addend value is selected based upon the threshold comparison and summed with the current pixel. While the present technique may not eliminate the compression artifacts, the addition of random noise renders the compression artifacts less noticeable to the human eye and, therefore, more aesthetically pleasing to a viewer.

    Image capturing devices using orientation detectors to implement automatic exposure mechanisms
    45.
    发明授权
    Image capturing devices using orientation detectors to implement automatic exposure mechanisms 有权
    使用定向检测器实现自动曝光机构的图像捕获设备

    公开(公告)号:US09007485B2

    公开(公告)日:2015-04-14

    申请号:US13942313

    申请日:2013-07-15

    Applicant: Apple Inc.

    Abstract: Several methods and apparatuses for implementing automatic exposure mechanisms for image capturing devices are described. In one embodiment, an orientation detector located in the device determines orientation data for the device. The automatic exposure mechanism projects an orientation vector into an image plane of an image sensor. Next, the automatic exposure mechanism adjusts an initial position of a metering area used for automatic exposure towards a target position based on the projected orientation vector. The automatic exposure mechanism optionally dampens the adjustment of the metering area.

    Abstract translation: 描述了用于实现图像捕获设备的自动曝光机构的几种方法和装置。 在一个实施例中,位于设备中的定向检测器确定该设备的取向数据。 自动曝光机构将取向矢量投影到图像传感器的图像平面中。 接下来,自动曝光机构基于投影的取向矢量将用于自动曝光的测光区域的初始位置调整到目标位置。 自动曝光机构可选择地抑制测光区域的调节。

    Systems, methods, and devices for flash exposure control using preflash statistics
    46.
    发明授权
    Systems, methods, and devices for flash exposure control using preflash statistics 有权
    使用预闪统计的闪光曝光控制的系统,方法和设备

    公开(公告)号:US08941775B2

    公开(公告)日:2015-01-27

    申请号:US14247505

    申请日:2014-04-08

    Applicant: Apple Inc.

    CPC classification number: H04N5/2354

    Abstract: Systems, methods, and devices for obtaining a properly exposed strobe-illuminated image are provided. One method for doing so may include, for example, gathering image capture statistics during a first period when a strobe is not emitting light and during a second period when the strobe emits a preflash. These image capture statistics may include distinct image capture control statistics and luma values associated with the periods. Final image capture control statistics then may be determined based at least in part on the first luma value normalized to the first image capture control statistics and the second luma value normalized to the second image capture control statistics. Thereafter, the final image capture control statistics may be used to capture a properly exposed strobe-illuminated image when the strobe emits a main flash.

    Abstract translation: 提供了用于获得正确暴露的频闪照明图像的系统,方法和装置。 一种这样做的方法可以包括例如在闪光灯不发光的第一时段期间和当闪光灯发出预闪光的第二时段期间收集图像拍摄统计。 这些图像捕获统计可以包括不同的图像捕获控制统计和与周期相关联的亮度值。 然后可以至少部分地基于归一化为第一图像捕获控制统计的第一亮度值和归一化为第二图像捕获控制统计的第二亮度值来确定最终图像捕获控制统计。 此后,当闪光灯发出主闪光时,最终的图像捕捉控制统计可用于捕获正确曝光的闪光灯照明图像。

    SYSTEMS, METHODS, AND DEVICES FOR FLASH EXPOSURE CONTROL USING PREFLASH STATISTICS
    47.
    发明申请
    SYSTEMS, METHODS, AND DEVICES FOR FLASH EXPOSURE CONTROL USING PREFLASH STATISTICS 审中-公开
    使用PREFLASH统计数据进行闪电曝光控制的系统,方法和装置

    公开(公告)号:US20140285709A1

    公开(公告)日:2014-09-25

    申请号:US14247505

    申请日:2014-04-08

    Applicant: Apple Inc.

    CPC classification number: H04N5/2354

    Abstract: Systems, methods, and devices for obtaining a properly exposed strobe-illuminated image are provided. One method for doing so may include, for example, gathering image capture statistics during a first period when a strobe is not emitting light and during a second period when the strobe emits a preflash. These image capture statistics may include distinct image capture control statistics and luma values associated with the periods. Final image capture control statistics then may be determined based at least in part on the first luma value normalized to the first image capture control statistics and the second luma value normalized to the second image capture control statistics. Thereafter, the final image capture control statistics may be used to capture a properly exposed strobe-illuminated image when the strobe emits a main flash.

    Abstract translation: 提供了用于获得正确暴露的频闪照明图像的系统,方法和装置。 一种这样做的方法可以包括例如在闪光灯不发光的第一时段期间和当闪光灯发出预闪光的第二时段期间收集图像拍摄统计。 这些图像捕获统计可以包括不同的图像捕获控制统计和与周期相关联的亮度值。 然后可以至少部分地基于归一化为第一图像捕获控制统计的第一亮度值和归一化为第二图像捕获控制统计的第二亮度值来确定最终图像捕获控制统计。 此后,当闪光灯发出主闪光时,最终的图像捕捉控制统计可用于捕获正确曝光的闪光灯照明图像。

    SYNC FRAME RECOVERY IN REAL TIME VIDEO TRANSMISSION SYSTEM
    48.
    发明申请
    SYNC FRAME RECOVERY IN REAL TIME VIDEO TRANSMISSION SYSTEM 有权
    实时视频传输系统中的SYNC FRAME RECOVERY

    公开(公告)号:US20130329809A1

    公开(公告)日:2013-12-12

    申请号:US13631719

    申请日:2012-09-28

    Applicant: APPLE INC.

    Abstract: An error recovery method may be engaged by an encoder to recover from misalignment between reference picture caches at the encoder and decoder. When a communication error is detected between a coder and a decoder, a number of non-acknowledged reference frames present in the decoder's reference picture cache may be estimated. Thereafter, frames may be coded as reference frames in a number greater or equal to the number of non-acknowledged reference frames that are estimated to be present in the decoder's reference picture cache. Thereafter, ordinary coding operations may resume. Typically, a final reference frame that is coded in the error recovery mode will be coded as a synchronization frame that has high coding quality. The coded reference frames that precede it may be coded at low quality (or may be coded as SKIP-coded frames). On reception and decoding, the preceding frames may cause the decoder to flush from its reference picture cache any non-acknowledged reference frames that otherwise might collide with the new synchronization frame. In this manner, alignment between the encoder and decoder may be restored.

    Abstract translation: 编码器可以接合错误恢复方法以从编码器和解码器处的参考图像高速缓存之间的未对准中恢复。 当在编码器和解码器之间检测到通信错误时,可以估计存在于解码器的参考图像高速缓存中的多个未确认参考帧。 此后,帧可以被编码为大于或等于估计存在于解码器的参考图像缓存中的未确认参考帧的数量的参考帧。 此后,可以恢复普通编码操作。 通常,以错误恢复模式编码的最终参考帧将被编码为具有高编码质量的同步帧。 其之前的编码参考帧可以以低质量编码(或者可以被编码为SKIP编码的帧)。 在接收和解码时,前述帧可能导致解码器从其参考图像缓存中刷新否则可能与新的同步帧相冲突的任何未确认的参考帧。 以这种方式,可以恢复编码器和解码器之间的对准。

    IMAGING SENSOR ANOMALOUS PIXEL COLUMN DETECTION AND CALIBRATION
    49.
    发明申请
    IMAGING SENSOR ANOMALOUS PIXEL COLUMN DETECTION AND CALIBRATION 有权
    成像传感器异常像素柱检测和校准

    公开(公告)号:US20130222608A1

    公开(公告)日:2013-08-29

    申请号:US13629455

    申请日:2012-09-27

    Applicant: Apple Inc.

    CPC classification number: H04N5/3658 H04N17/002

    Abstract: An imaging sensor is signaled to capture a digital image of a dark scene. For each of the pixel columns in the image, a respective column value is computed that represents at least some of the pixels in the column. For each of the pixel columns in the image, a respective comparison is made between the respective column value of the pixel column and a reference value. A respective column score is computed, for each of the pixel columns, based on the respective comparison. An indication that identifies one or more of the pixel columns as anomalous is stored, when the respective column score of the one or more the pixel columns does not meet a criterion. Other embodiments are also described and claimed.

    Abstract translation: 信号通过成像传感器捕获黑暗场景的数字图像。 对于图像中的每个像素列,计算表示列中的至少一些像素的相应列值。 对于图像中的每个像素列,在像素列的相应列值和参考值之间进行相应的比较。 基于相应的比较,针对每个像素列计算相应的列分数。 当一个或多个像素列的相应列分数不满足标准时,存储识别一个或多个像素列为异常的指示。 还描述和要求保护其他实施例。

    SYSTEM AND METHOD FOR MASKING VISUAL COMPRESSION ARTIFACTS IN DECODED VIDEO STREAMS

    公开(公告)号:US20130039432A1

    公开(公告)日:2013-02-14

    申请号:US13651181

    申请日:2012-10-12

    Applicant: Apple Inc.

    CPC classification number: H04N19/86

    Abstract: A technique is provided for processing decoded video data to mask visual compression artifacts resulting from video compression. In accordance with this technique, a hardware block is provided for generating and adding random noise to the decoded video stream. In one embodiment, a random number is generated for each pixel of the decoded video data and compared against one or more threshold values to determine a threshold range. In such an embodiment, a noise addend value is selected based upon the threshold comparison and summed with the current pixel. While the present technique may not eliminate the compression artifacts, the addition of random noise renders the compression artifacts less noticeable to the human eye and, therefore, more aesthetically pleasing to a viewer.

Patent Agency Ranking