公开(公告)号：WO2016191554A1

公开(公告)日：2016-12-01

申请号：PCT/US2016/034317

申请日：2016-05-26

Applicant: GOOGLE INC.

Inventor： ANDERSON, Robert ,  SEITZ, Steven Maxwell ,  ESTEBAN, Carlos Hernandez

IPC: H04N5/232 ,  H04N1/00 ,  G06T3/40 ,  H04N13/02

CPC classification number: H04N5/23238 ,  G02B27/017 ,  G06T1/0007 ,  G06T3/4038 ,  G06T2200/32 ,  G06T2207/30244 ,  G09G5/14 ,  H04N1/00183 ,  H04N5/23222 ,  H04N5/23293 ,  H04N13/221

Abstract: Systems and methods for capturing omnistereo content for a mobile device may include receiving an indication to capture a plurality of images of a scene, capturing the plurality of images using a camera associated with a mobile device and displaying on a screen of the mobile device and during capture, a representation of the plurality of images and presenting a composite image that includes a target capture path and an indicator that provides alignment information corresponding to a source capture path associated with the mobile device during capture of the plurality of images. The system may detect that a portion of the source capture path does not match a target capture path. The system can provide an updated indicator in the screen that may include a prompt to a user of the mobile device to adjust the mobile device to align the source capture path with the target capture path.

Abstract translation: 用于捕获移动设备的omnistereo内容的系统和方法可以包括：接收用于捕获场景的多个图像的指示，使用与移动设备相关联的相机捕获多个图像，并且在移动设备的屏幕上以及在 捕捉多个图像的表示，并且在捕获多个图像期间呈现包括目标捕获路径的合成图像和提供与与移动装置相关联的源捕获路径相对应的对准信息的指示符。 系统可以检测到源捕获路径的一部分与目标捕获路径不匹配。 该系统可以在屏幕中提供可以包括对移动设备的用户的提示来调整移动设备以使源捕获路径与目标捕获路径对准的更新的指示符。

公开(公告)号：WO2016191708A1

公开(公告)日：2016-12-01

申请号：PCT/US2016/034711

申请日：2016-05-27

Applicant: GOOGLE INC.

Inventor： WEAVER, Joshua ,  ANDERSON, Robert ,  WU, Changchang ,  KRAININ, Michael ,  GALLUP, David ,  SEITZ, Steven Maxwell ,  ESTEBAN, Carlos Hernandez ,  VALENTE, Matthew Thomas ,  HOOVER, Christopher Edward ,  GOOSSENS, Erik Hubert Dolly

IPC: G03B17/56 ,  G03B37/04 ,  H04N5/225 ,  H04N5/232 ,  H04N13/02 ,  H04N13/04

CPC classification number: H04N13/243 ,  G03B17/561 ,  G03B37/04 ,  H04N5/2251 ,  H04N5/2258 ,  H04N5/23238 ,  H04N5/247 ,  H04N13/282 ,  H04N13/344

Abstract: Systems and methods are related to a camera rig and generating stereoscopic panoramas from captured images for display in a virtual reality (VR) environment.

Abstract translation: 系统和方法与相机钻机相关，并且从捕获的图像生成立体全景，以便在虚拟现实（VR）环境中显示。

公开(公告)号：WO2016191467A1

公开(公告)日：2016-12-01

申请号：PCT/US2016/034077

申请日：2016-05-25

Applicant: GOOGLE INC.

Inventor： GALLUP, David ,  ANDERSON, Robert ,  ESTEBAN, Carlos Hernandez ,  SEITZ, Steven Maxwell ,  ADAMS, Riley

IPC: H04N13/02 ,  H04N13/00 ,  H04N13/04

CPC classification number: G06T3/4038 ,  H04N13/106 ,  H04N13/239 ,  H04N13/243 ,  H04N13/344 ,  H04N13/366

Abstract: Systems and methods are described for defining a set of images based on captured images, receiving a viewing direction associated with a user of a virtual reality (VR) head mounted display, receiving an indication of a change in the viewing direction. The methods further include configuring, a re-projection of a portion of the set of images, the re-projection based at least in part on the changed viewing direction and a field of view associated with the captured images, and converting the portion from a spherical perspective projection into a planar perspective projection, rendering by the computing device and for display in the VR head mounted display, an updated view based on the re-projection, the updated view configured to correct distortion and provide stereo parallax in the portion, and providing, to the head mounted display, the updated view including a stereo panoramic scene corresponding to the changed viewing direction.

Abstract translation: 描述了基于捕获的图像来定义一组图像的系统和方法，接收与虚拟现实（VR）头戴式显示器的用户相关联的观看方向，接收观看方向的改变的指示。 所述方法还包括至少部分地基于所改变的观察方向和与所捕获图像相关联的视场来配置，所述图像集合的一部分的重新投影，所述重新投影将所述部分从 球面透视投影成平面透视投影，由计算设备呈现并用于显示在VR头戴式显示器中，基于重新投影的更新视图，配置为校正失真并在该部分中提供立体视差的更新视图，以及 向头戴式显示器提供包括与改变的观看方向对应的立体全景场景的更新视图。

公开(公告)号：EP3058451A1

公开(公告)日：2016-08-24

申请号：EP14781747.2

申请日：2014-09-17

Applicant: Google Inc.

Inventor： GALLUP, David Robert ,  CHEN, Liyong ,  ZHOU, Shuchang ,  SEITZ, Steven Maxwell

IPC: G06F3/0485 ,  G06F3/0484

CPC classification number: G06F3/0485 ,  G06F3/04845

Abstract: Aspects of the disclosure relate generally to providing a user with an image navigation experience. In order to do so, a reference image may be identified. A set of potential target images for the reference image may also be identified. A drag vector for user input relative to the reference image is determined. For particular image of the set of target images an associated cost is determined based at least in part on a cost function and the drag vector. A target image is selected based on the determined associated costs.

公开(公告)号：EP3058505A1

公开(公告)日：2016-08-24

申请号：EP14777243.8

申请日：2014-09-17

Applicant: Google Inc.

Inventor： LOOKINGBILL, Andrew ,  SEITZ, Steven Maxwell

IPC: G06K9/00 ,  G06T7/00

CPC classification number: G06T7/593 ,  G06K9/00208 ,  G06T7/33 ,  G06T7/579 ,  G06T15/10 ,  G06T19/00 ,  G06T2200/04 ,  G06T2200/08 ,  G06T2207/10016 ,  G06T2207/20221 ,  G06T2215/16

Abstract: An exemplary method includes prompting a user to capture video data at a location. The location is associated with navigation directions for the user. Information representing visual orientation and positioning information associated with the captured video data is received by one or more computing devices, and a stored data model representing a 3D geometry depicting objects associated with the location is accessed. Between corresponding images from the captured video data and projections of the 3D geometry, one or more candidate change regions are detected. Each candidate change region indicates an area of visual difference between the captured video data and projections. When it is detected that a count of the one or more candidate change regions is below a threshold, the stored model data is updated with at least part of the captured video data based on the visual orientation and positioning information associated with the captured video data.

Abstract translation: 一种示例性方法包括提示用户在某个位置拍摄视频数据。 该位置与用户的导航方向相关联。 表示与捕获的视频数据相关联的视觉定位和定位信息的信息由一个或多个计算设备接收，并且存储表示描绘与位置相关联的对象的3D几何的存储的数据模型。 在所捕获的视频数据和3D几何的投影的相应图像之间，检测一个或多个候选变化区域。 每个候选变化区域表示所捕获的视频数据和投影之间的视差的区域。 当检测到一个或多个候选变化区域的计数低于阈值时，基于与捕获的视频数据相关联的视觉取向和定位信息，利用所捕获的视频数据的至少一部分来更新存储的模型数据。