公开(公告)号：US20150341654A1

公开(公告)日：2015-11-26

申请号：US14284701

申请日：2014-05-22

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung

IPC: H04N19/50

CPC classification number: H04N19/50 ,  H04N19/105 ,  H04N19/142 ,  H04N19/172 ,  H04N19/59 ,  H04N19/87

Abstract: A video coder, responsive to detection of a zooming transition in source video, estimates a scale factor and a zooming rectangle for a reference frame, scales content of the reference frame within the zooming rectangle according to the scaling factor, codes content of a new frame of the source video predictively using the scaled reference frame as a basis of prediction, and transmits coded video data obtained from the predictive coding to a decoder along with an indication of the scaling factor and zooming rectangle.

Abstract translation: 视频编码器响应于源视频中的缩放转换的检测，估计用于参考帧的比例因子和缩放矩形，根据缩放因子缩放缩放矩形内的参考帧的内容，对新帧的内容进行编码 的源视频预测性地使用缩放参考帧作为预测的基础，并且将从预测编码获得的编码视频数据与缩放因子和缩放矩形的指示一起发送到解码器。

公开(公告)号：US20150326896A1

公开(公告)日：2015-11-12

申请号：US14710520

申请日：2015-05-12

Applicant: Apple Inc.

Inventor： Yeping Su ,  Jiefu Zhai ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung

IPC: H04N21/2343 ,  H04N21/2385 ,  H04N21/438 ,  H04N19/184 ,  H04N21/4402 ,  H04N19/50 ,  H04N19/186 ,  H04N21/234 ,  H04N21/44

CPC classification number: H04N19/30 ,  H04N19/46

Abstract: Systems and methods are provided for processing high quality video data, such as data having a higher than standard bit depth, a high dynamic range, or a wide or custom color gamut, to be compatible with conventional encoders and decoders without significant loss of quality. High quality data is encoded into a plurality of layers with a base layer having the standard quality data and one or more higher quality layers. Decoding systems and methods may map the base layer to the dynamic range or color gamut of the enhancement layer, combine the layers, and map the combined layers to a dynamic range or color gamut appropriate for the target display. Each of the standard quality and the high quality data may be encoded as a plurality of tiers of increasing quality and reference lower level tiers as sources of prediction during predictive coding.

Abstract translation: 提供了用于处理高质量视频数据的系统和方法，例如具有高于标准位深度，高动态范围或宽或定制色域的数据，以与常规编码器和解码器兼容，而没有显着的质量损失。 高质量数据被编码成具有基层的多层，具有标准质量数据和一个或多个更高质量的层。 解码系统和方法可以将基本层映射到增强层的动态范围或色域，组合层，并将组合层映射到适合于目标显示的动态范围或色域。 标准质量和高质量数据中的每一个可以被编码为增加质量的多个层级和作为预测编码期间的预测源的较低级别的参考。

公开(公告)号：US20150193013A1

公开(公告)日：2015-07-09

申请号：US14664308

申请日：2015-03-20

Applicant: Apple Inc.

Inventor： Yao-Chung Lin ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: G06F3/03 ,  H04N7/18

CPC classification number: G06F3/03 ,  G06F1/1694 ,  G06F2200/1636 ,  H04N7/183

Abstract: Embodiments of the present invention generate estimates of device motion from two data sources on a computing device—a motion sensor and a camera. The device may compare the estimates to each other to determine if they agree. If they agree, the device may confirm that device motion estimates based on the motion sensor are accurate and may output those estimates to an application within the device. If the device motion estimates disagree, the device may alter the motion estimates obtained from the motion sensor before outputting them to the application.

Abstract translation: 本发明的实施例从计算设备上的两个数据源（运动传感器和照相机）生成设备运动的估计。 设备可以将估计值相互比较以确定它们是否一致。 如果他们同意，设备可以确认基于运动传感器的设备运动估计是准确的，并且可以将这些估计值输出到设备内的应用。 如果设备运动估计不同意，则在将其输出到应用程序之前，设备可以改变从运动传感器获得的运动估计。

公开(公告)号：US20150103135A1

公开(公告)日：2015-04-16

申请号：US14579613

申请日：2014-12-22

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Joe Abuan ,  Jim Normile ,  Haitao Guo ,  Hyeonkuk Jeong

IPC: H04N5/262 ,  H04N7/15 ,  H04N5/272 ,  H04N7/14

CPC classification number: H04N7/141 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/04886 ,  G06F9/451 ,  G09G5/14 ,  H04M1/72583 ,  H04N5/2258 ,  H04N5/2624 ,  H04N5/272 ,  H04N7/147 ,  H04N7/15

Abstract: Some embodiments provide a novel method for in-conference adjustment of encoded video pictures captured by a mobile device having at least first and second cameras. The method may involve real-time modifications of composite video displays that are generated by the mobile devices involved in such a conference. Specifically, in some embodiments, the mobile devices generate composite displays that simultaneously display multiple videos captured by multiple cameras of one or more devices. In some cases, the composite displays place the videos in adjacent display areas (e.g., in adjacent windows). In other cases, the composite display is a picture-in-picture (PIP) display that includes at least two display areas that show two different videos where one of the display areas is a background main display area and the other is a foreground inset display area that overlaps the background main display area.

Abstract translation: 一些实施例提供了一种用于会议调整由具有至少第一和第二相机的移动设备捕获的编码视频图像的新颖方法。 该方法可以涉及由这样的会议中涉及的移动设备生成的复合视频显示的实时修改。 具体地，在一些实施例中，移动设备产生同时显示由一个或多个设备的多个摄像机捕获的多个视频的复合显示器。 在某些情况下，复合显示将视频放置在相邻的显示区域中（例如，在相邻窗口中）。 在其他情况下，复合显示器是画中画（PIP）显示器，其包括显示两个不同视频的至少两个显示区域，其中一个显示区域是背景主显示区域，另一个是前景插入显示 与背景主显示区域重叠的区域。

公开(公告)号：US20140362927A1

公开(公告)日：2014-12-11

申请号：US14065981

申请日：2013-10-29

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Douglas Scott Price ,  Hsi-Jung Wu ,  Xiaosong Zhou

IPC: H04N19/142 ,  H04N19/119 ,  H04N19/176

CPC classification number: H04N19/176 ,  H04N19/119 ,  H04N19/124 ,  H04N19/14 ,  H04N19/142

Abstract: A system may include a detector, a controller, and an encoder. The detector may receive data from video input to detect a group of pixels in a video sequence, and may determine whether the group of pixels needs additional bits for encoding. The controller may determine the number of bits for the additional bits and may allocate the additional bits with the number of bits in a data stream. The encoder may by controlled by the controller to encode the group of pixels with the additional bits, and output to the encoded output.

Abstract translation: 系统可以包括检测器，控制器和编码器。 检测器可以从视频输入接收数据以检测视频序列中的一组像素，并且可以确定像素组是否需要用于编码的附加位。 控制器可以确定附加比特的比特数，并且可以用数据流中的比特数分配附加比特。 编码器可以由控制器控制以用附加位对像素组进行编码，并输出到编码输出。

公开(公告)号：US20140354759A1

公开(公告)日：2014-12-04

申请号：US14263889

申请日：2014-04-28

Applicant: Apple Inc.

Inventor： Elizabeth C. Cranfill ,  Stephen O. Lemay ,  Joe S. Abuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Roberto Garcia, JR.

IPC: H04N7/15 ,  G06F3/0484

CPC classification number: H04N7/141 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/04886 ,  G06F9/451 ,  G09G5/14 ,  H04M1/72583 ,  H04N5/2258 ,  H04N5/2624 ,  H04N5/272 ,  H04N7/147 ,  H04N7/15

Abstract: Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

Abstract translation: 一些实施例提供了使用第一移动设备发起视频会议的方法。 该方法在通过具有第二设备的无线通信网络的音频呼叫期间呈现在第一移动设备上的用于从音频呼叫切换到视频会议的可选择的用户界面（UI）项目。 该方法接收可选UI项目的选择。 该方法启动视频会议而不终止音频通话。 该方法在允许第一和第二设备呈现通过视频会议交换的音频和视频数据之前终止音频呼叫。

公开(公告)号：US20140092987A1

公开(公告)日：2014-04-03

申请号：US13893906

申请日：2013-05-14

Applicant: Apple Inc.

Inventor： David W. Singer ,  Alexandros Tourapis ,  Athanasios Leontaris ,  Xiaosong Zhou

IPC: H04N7/26

CPC classification number: H04N19/70 ,  H04N19/436 ,  H04N19/44 ,  H04N19/46 ,  H04N19/91

Abstract: In a communication system, parallel encoding and decoding of serially-coded data occurs in a manner that supports low latency communication. A plurality of data items may be coded as serially-coded data sequences and a transmission sequence may be built from them. An index table may be built having a plurality of entries representing respective start points of the serially-coded data sequences within the transmission sequence. The transmission sequence may be transmitted to a channel and, thereafter, the index table may be transmitted. Latencies otherwise involved in inserting an index table into the beginning of a transmission sequence may be avoided.

公开(公告)号：US08683301B2

公开(公告)日：2014-03-25

申请号：US13785859

申请日：2013-03-05

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hyeonkuk Jeong ,  Yan Yang ,  Dazhong Zhang ,  Hsi-Jung Wu

IPC: H03M13/00

CPC classification number: H03M13/05 ,  H03M13/1102 ,  H03M13/1515 ,  H03M13/152 ,  H03M13/27 ,  H03M13/29 ,  H03M13/2957 ,  H03M13/373 ,  H03M13/3746 ,  H04L1/005 ,  H04L1/0057 ,  H04L1/008

Abstract: Coded video data may be transmitted between an encoder and a decoder using multiple FEC codes and/or packets for error detection and correction. Only a subset of the FEC packets need be transmitted between the encoder and decoder. The FEC packets of each FEC group may take, as inputs, data packets of a current FEC group and also an untransmitted FEC packet of a preceding FEC group. Due to relationships among the FEC packets, when transmission errors arise and data packets are lost, there remain opportunities for a decoder to recover lost data packets from earlier-received FEC groups when later-received FEC groups are decoded. This opportunity to recover data packets from earlier FEC groups may be useful in video coding and other systems, in which later-received data often cannot be decoded unless earlier-received data is decoded properly.

Abstract translation: 可以在编码器和解码器之间使用多个用于错误检测和校正的FEC码和/或包进行编码的视频数据。 只有FEC数据包的一部分需要在编码器和解码器之间传输。 每个FEC组的FEC分组可以采用当前FEC组的数据分组和前一个FEC组的未发送FEC分组的输入。 由于FEC分组之间的关系，当传输错误出现并且数据分组丢失时，当稍后接收的FEC组被解码时，解码器仍然有机会恢复来自早先接收的FEC组的丢失的数据分组。 从先前的FEC组恢复数据分组的机会在视频编码和其他系统中可能是有用的，其中后期接收的数据通常不能被解码，除非先前接收到的数据被正确解码。

公开(公告)号：US12302035B2

公开(公告)日：2025-05-13

申请号：US18140449

申请日：2023-04-27

Applicant: Apple Inc.

Inventor： Elizabeth C. Cranfill ,  Stephen O. Lemay ,  Joe S. Abuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Roberto Garcia, Jr.

IPC: H04N7/14 ,  G06F3/04812 ,  G06F3/04817 ,  G06F3/0482 ,  G06F3/04842 ,  G06F3/0486 ,  G06F3/0488 ,  G06F3/04886 ,  G06F9/451 ,  G09G5/14 ,  H04M1/72469 ,  H04N5/262 ,  H04N5/272 ,  H04N7/15 ,  H04N23/45

Abstract: Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

公开(公告)号：US11924391B2

公开(公告)日：2024-03-05

申请号：US18083468

申请日：2022-12-16

Applicant: Apple Inc.

Inventor： Fanyi Duanmu ,  Jun Xin ,  Hsi-Jung Wu ,  Xiaosong Zhou

IPC: H04N13/117 ,  H04N13/178 ,  H04N21/218 ,  H04N21/24

CPC classification number: H04N13/117 ,  H04N13/178 ,  H04N21/21805 ,  H04N21/2401 ,  H04N21/2402

Abstract: A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.