公开(公告)号：US11044398B2

公开(公告)日：2021-06-22

申请号：US16583176

申请日：2019-09-25

Applicant: Apple Inc.

Inventor： Gabriel D. Molina ,  Ricardo J. Motta ,  Gary L. Vondran, Jr. ,  Dan Lelescu ,  Tobias Rick ,  Brett Miller

IPC: H04N5/232 ,  H04N13/106 ,  G06T7/557 ,  H04N13/282 ,  H04N13/117 ,  G06T5/50 ,  G06T7/00 ,  G06T1/00

Abstract: A light field panorama system in which a user holding a mobile device performs a gesture to capture images of a scene from different positions. Additional information, for example position and orientation information, may also be captured. The images and information may be processed to determine metadata including the relative positions of the images and depth information for the images. The images and metadata may be stored as a light field panorama. The light field panorama may be processed by a rendering engine to render different 3D views of the scene to allow a viewer to explore the scene from different positions and angles with six degrees of freedom. Using a rendering and viewing system such as a mobile device or head-mounted display, the viewer may see behind or over objects in the scene, zoom in or out on the scene, or view different parts of the scene.