公开(公告)号：WO2017139034A1

公开(公告)日：2017-08-17

申请号：PCT/US2016/068026

申请日：2016-12-21

Applicant: GOOGLE INC.

Inventor： RUSSELL, Andrew Ian

IPC: G02B27/01 ,  H04N13/04

CPC classification number: G06F3/012 ,  G02B27/0179 ,  G02B2027/0187 ,  G06T1/60 ,  G06T19/006 ,  H04N13/344

Abstract: The locations of pixels in a frame [220] are adjusted at a display controller [104] after the frame has been generated by a graphics processing unit (GPU) [102]or other processor and provided to the display controller. The adjusting of the pixel locations therefore occurs as close as possible to a display panel in a display system, thereby supporting rapid changes to pixel positions.

Abstract translation: 在图形处理单元（GPU）[102]或其他处理器已经生成帧并且被提供给显示控制器[104]之后，帧[220]中的像素的位置被调整到显示控制器[104] 显示控制器。 因此，像素位置的调整尽可能靠近显示系统中的显示面板，从而支持快速改变像素位置。

公开(公告)号：WO2017100760A1

公开(公告)日：2017-06-15

申请号：PCT/US2016/066150

申请日：2016-12-12

Applicant: GOOGLE INC.

Inventor： RUSSELL, Andrew Ian

IPC: H04N13/02 ,  H04N5/232 ,  H04N5/225 ,  G03B37/00 ,  G03B37/04

CPC classification number: G02B27/26 ,  G03B37/00 ,  G03B37/04 ,  H04N5/2254 ,  H04N5/23238 ,  H04N13/204 ,  H04N13/239 ,  H04N13/243 ,  H04N13/282

Abstract: An apparatus includes at least one camera and a refractor configured to change a direction of a light toward a lens of the camera. The refractor has a shape configured to redirect light representing an image at two focal points, the two focal points are on a same plane and at a same distance from the at least one camera, and the refractor is positioned between the two focal points and the at least one camera.

Abstract translation: 一种装置包括至少一个照相机和折射镜，折射镜被配置为朝照相机的镜头改变光的方向。 折射器具有被配置为在两个焦点处重新引导表示图像的光的形状，两个焦点位于同一平面上并且与至少一个照相机处于相同距离处，并且折射器位于两个焦点之间， 至少有一台相机。

公开(公告)号：WO2016025161A1

公开(公告)日：2016-02-18

申请号：PCT/US2015/042323

申请日：2015-07-27

Applicant: GOOGLE INC.

Inventor： RUSSELL, Andrew Ian ,  MASSIMINO, Pascal

IPC: H04N9/64 ,  H04N19/59 ,  H04N19/85

CPC classification number: H04N1/409 ,  H04N1/6027 ,  H04N9/646 ,  H04N19/154 ,  H04N19/59 ,  H04N19/895

Abstract: A method (400) includes obtaining (410), at one or more computing devices, an input image; determining (420) a first value of a quality metric for the input image; generating (430) a first chroma subsampled representation of the input image; and generating (440) a reconstructed image based on the chroma subsampled representation. The method also includes determining a second value of the quality metric for the reconstructed image; determining an error value based on the first value of the quality metric and the second value of the quality metric; and generating a second chroma subsampled representation of the input image based in part on the error value.

Abstract translation: 方法（400）包括在一个或多个计算设备处获取（410）输入图像; 确定（420）所述输入图像的质量度量的第一值; 产生（430）所述输入图像的第一色度子采样表示; 以及基于所述色度子采样表示来生成（440）重构图像。 该方法还包括确定重建图像的质量度量的第二值; 基于质量度量的第一值和质量度量的第二值确定误差值; 以及部分地基于所述误差值来生成所述输入图像的第二色度子采样表示。

公开(公告)号：WO2017044790A1

公开(公告)日：2017-03-16

申请号：PCT/US2016/051012

申请日：2016-09-09

Applicant: GOOGLE INC.

Inventor： RUSSELL, Andrew Ian

IPC: H04N13/00 ,  H04N13/04 ,  G02B27/01

CPC classification number: H04N13/344 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0112 ,  G02B2027/0134 ,  G02B2027/0138 ,  G02B2027/014 ,  H04N13/117 ,  H04N13/133 ,  H04N13/15 ,  H04N13/366

Abstract: A method includes receiving an indication of a field of view associated with a three- dimensional (3D) image being displayed on a head mount display (HMD), receiving an indication of a depth of view associated with the 3D image being displayed on the HMD, selecting a first right eye image and a second right eye image based on the field of view, combining the first right eye image and the second right eye image based on the depth of view, selecting a first left eye image and a second left eye image based on the field of view, and combining the first left eye image and the second left eye image based on the depth of view.

Abstract translation: 一种方法包括接收与正在显示在头戴式显示器（HMD）上的三维（3D）图像相关联的视野的指示，接收与在HMD上显示的3D图像相关联的深度的指示 ，基于所述视场来选择第一右眼图像和第二右眼图像，基于所述深度合成所述第一右眼图像和所述第二右眼图像，选择第一左眼图像和所述第二左眼图像 基于视场的图像，并且基于深度来组合第一左眼图像和第二左眼图像。

公开(公告)号：WO2017049055A1

公开(公告)日：2017-03-23

申请号：PCT/US2016/052086

申请日：2016-09-16

Applicant: GOOGLE INC.

Inventor： RUSSELL, Andrew Ian

IPC: G03B37/04 ,  H04N5/232 ,  H04N13/00 ,  H04N13/02 ,  G02B27/01

CPC classification number: G06T3/4038 ,  G02B27/017 ,  G02B2027/0134 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0187 ,  G03B37/04 ,  H04N5/23238 ,  H04N5/247 ,  H04N13/111 ,  H04N13/117 ,  H04N13/128 ,  H04N13/239 ,  H04N13/243 ,  H04N13/261 ,  H04N13/271 ,  H04N13/344 ,  H04N2213/001

Abstract: Systems and methods are described for capturing spherical content. The systems and methods can include determining a region within a plurality of images captured with a plurality of cameras in which to transform two-dimensional data into three-dimensional data, calculating a depth value for a portion of pixels in the region, generating a spherical image, the spherical image including image data for the portion of pixels in the region, constructing, using the image data, a three-dimensional surface in three-dimensional space of a computer graphics object generated by an image processing system, generating, using the image data, a texture mapping to a surface of the computer graphics object, and transmitting the spherical image and the texture mapping for display in a head-mounted display device.

Abstract translation: 描述了捕获球形内容的系统和方法。 系统和方法可以包括确定用多个摄像机拍摄的多个图像内的区域，其中将二维数据变换为三维数据，计算该区域中的一部分像素的深度值，产生球面 图像，所述球面图像包括所述区域中的所述像素部分的图像数据，使用所述图像数据构建由图像处理系统生成的计算机图形对象的三维空间中的三维表面， 图像数据，映射到计算机图形对象的表面的纹理映射，以及发送球形图像和纹理映射以便在头戴式显示设备中显示。

公开(公告)号：WO2016064862A1

公开(公告)日：2016-04-28

申请号：PCT/US2015/056442

申请日：2015-10-20

Applicant: GOOGLE INC.

Inventor： GRANGE, Adrian William ,  CONVERSE, Alexander Jay ,  MUKHERJEE, Debargha ,  ADAMS, Riley ,  BANKOSKI, Jim ,  RUSSELL, Andrew Ian

IPC: H04N19/44 ,  H04N19/107

CPC classification number: H04N19/167 ,  G06T11/00 ,  H04N5/23238 ,  H04N19/105 ,  H04N19/124 ,  H04N19/593 ,  H04N19/597

Abstract: A method for encoding a spherical video is disclosed. The method includes mapping a frame of the spherical video to a two dimensional representation based on a projection. Further, in a prediction process the method includes determine whether at least one block associated with a prediction scheme is on a boundary of the two dimensional representation, and upon determining the at least one block associated with the prediction scheme is on the boundary, select an adjacent end block as a block including at least one pixel for use during the prediction process, the adjacent end block being associated with two or more boundaries of the two dimensional representation.

Abstract translation: 公开了一种用于编码球面视频的方法。 该方法包括基于投影将球面视频的帧映射到二维表示。 此外，在预测处理中，该方法包括确定与预测方案相关联的至少一个块是否在二维表示的边界上，并且在确定与预测方案相关联的至少一个块在边界上时，选择 相邻端块作为包括在预测处理期间使用的至少一个像素的块，相邻端块与二维表示的两个或更多个边界相关联。

公开(公告)号：WO2016022322A1

公开(公告)日：2016-02-11

申请号：PCT/US2015/042322

申请日：2015-07-27

Applicant: GOOGLE INC.

Inventor： RUSSELL, Andrew Ian

IPC: G06T5/00

CPC classification number: G06T3/40 ,  G06T5/002 ,  G06T5/007 ,  G06T7/13 ,  G06T7/136 ,  G06T9/00 ,  G06T2207/20016 ,  G06T2207/20021 ,  G06T2207/20192 ,  H04N19/85

Abstract: Processing an image having a first bit depth includes performing two or more iterations of a bit depth enhancement operation that increases the bit depth of the image to a second bit depth that is higher than the first bit depth. The bit depth enhancement operation includes dividing the image into a plurality of areas, performing an edge detection operation to identify one or more areas from the plurality of areas that do not contain edge features, and applying a blur to the one or more areas from the plurality of areas that do not contain edge features. In a first iteration of the of the bit depth enhancement operation, the plurality of areas includes a first number of areas, and the number of areas included in the plurality of areas decreases with each subsequent iteration of the bit depth enhancement operation.

Abstract translation: 处理具有第一比特深度的图像包括执行比特深度增强操作的两次或更多次迭代，其将图像的比特深度增加到高于第一比特深度的第二比特深度。 比特深度增强操作包括将图像划分成多个区域，执行边缘检测操作以识别来自不包含边缘特征的多个区域中的一个或多个区域，以及对来自该区域的一个或多个区域应用模糊 多个不包含边缘特征的区域。 在位深度增强操作的第一迭代中，多个区域包括第一数量的区域，并且随着位深度增强操作的每个后续迭代，包括在多个区域中的区域的数量减少。

公开(公告)号：EP3210379A1

公开(公告)日：2017-08-30

申请号：EP15853542.7

申请日：2015-10-20

Applicant: Google Inc.

Inventor： GRANGE, Adrian William ,  CONVERSE, Alexander Jay ,  MUKHERJEE, Debargha ,  ADAMS, Riley ,  BANKOSKI, Jim ,  RUSSELL, Andrew Ian

IPC: H04N19/44 ,  H04N19/107

CPC classification number: H04N19/167 ,  G06T11/00 ,  H04N5/23238 ,  H04N19/105 ,  H04N19/124 ,  H04N19/593 ,  H04N19/597

Abstract: A method for encoding a spherical video is disclosed. The method includes mapping a frame of the spherical video to a two dimensional representation based on a projection. Further, in a prediction process the method includes determine whether at least one block associated with a prediction scheme is on a boundary of the two dimensional representation, and upon determining the at least one block associated with the prediction scheme is on the boundary, select an adjacent end block as a block including at least one pixel for use during the prediction process, the adjacent end block being associated with two or more boundaries of the two dimensional representation.

Abstract translation: 公开了一种用于编码球形视频的方法。 该方法包括基于投影将球形视频的帧映射到二维表示。 此外，在预测过程中，该方法包括确定与预测方案相关联的至少一个块是否在二维表示的边界上，并且在确定与预测方案相关联的至少一个块位于边界上时，选择 相邻结束块作为包括在预测过程期间使用的至少一个像素的块，相邻结束块与二维表示的两个或更多个边界相关联。

公开(公告)号：EP3180910A1

公开(公告)日：2017-06-21

申请号：EP15751181.7

申请日：2015-07-27

Applicant: Google Inc.

Inventor： RUSSELL, Andrew Ian ,  MASSIMINO, Pascal

IPC: H04N9/64 ,  H04N19/59 ,  H04N19/85

CPC classification number: H04N1/409 ,  H04N1/6027 ,  H04N9/646 ,  H04N19/154 ,  H04N19/59 ,  H04N19/895

Abstract: A method (400) includes obtaining (410), at one or more computing devices, an input image; determining (420) a first value of a quality metric for the input image; generating (430) a first chroma subsampled representation of the input image; and generating (440) a reconstructed image based on the chroma subsampled representation. The method also includes determining a second value of the quality metric for the reconstructed image; determining an error value based on the first value of the quality metric and the second value of the quality metric; and generating a second chroma subsampled representation of the input image based in part on the error value.

Abstract translation: 一种方法包括：在一个或多个计算设备处获得输入图像; 确定输入图像的质量度量的第一值; 生成输入图像的第一色度子采样表示; 以及基于色度子采样表示生成重构图像。 该方法还包括确定重建图像的质量度量的第二值; 基于质量度量的第一值和质量度量的第二值来确定误差值; 以及部分基于所述误差值来生成所述输入图像的第二色度子采样表示。

公开(公告)号：EP3178063A1

公开(公告)日：2017-06-14

申请号：EP15750521.5

申请日：2015-07-27

Applicant: Google Inc.

Inventor： RUSSELL, Andrew Ian

IPC: G06T5/00

CPC classification number: G06T3/40 ,  G06T5/002 ,  G06T5/007 ,  G06T7/13 ,  G06T7/136 ,  G06T9/00 ,  G06T2207/20016 ,  G06T2207/20021 ,  G06T2207/20192 ,  H04N19/85

Abstract: Processing an image having a first bit depth includes performing two or more iterations of a bit depth enhancement operation that increases the bit depth of the image to a second bit depth that is higher than the first bit depth. The bit depth enhancement operation includes dividing the image into a plurality of areas, performing an edge detection operation to identify one or more areas from the plurality of areas that do not contain edge features, and applying a blur to the one or more areas from the plurality of areas that do not contain edge features. In a first iteration of the of the bit depth enhancement operation, the plurality of areas includes a first number of areas, and the number of areas included in the plurality of areas decreases with each subsequent iteration of the bit depth enhancement operation.

Abstract translation: 一种用于处理具有第一比特深度的图像的方法包括执行比特深度增强操作的两次或更多次迭代，所述比特深度增强操作将图像的比特深度增加到高于第一比特深度的第二比特深度。 位深度增强操作包括将图像划分成多个区域，执行边缘检测操作以从多个区域中识别不包含边缘特征的一个或多个区域，并且将模糊应用于来自第一区域的一个或多个区域 多个不包含边缘特征的区域。 在比特深度增强操作的第一次迭代中，多个区域包括第一数量的区域，并且随着比特深度增强操作的每次后续迭代，包括在多个区域中的区域的数量减少。