公开(公告)号：US09681096B1

公开(公告)日：2017-06-13

申请号：US15275074

申请日：2016-09-23

Applicant: Apple Inc.

Inventor： Ricardo J. Motta ,  Gary L. Vondran, Jr. ,  Manohar B. Srikanth ,  Brett D. Miller

IPC: H04N7/15 ,  H04N7/14 ,  G06F3/01 ,  H04N5/247 ,  H04N13/00

CPC classification number: H04N13/156 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  H04N5/23219 ,  H04N5/247 ,  H04N7/142 ,  H04N7/144 ,  H04N7/147 ,  H04N7/18 ,  H04N13/117 ,  H04N13/122 ,  H04N13/243

Abstract: This disclosure pertains to operations, systems, and computer readable media to capture images of a scene using a camera array and process the captured images based on a viewer's point of view (POV) for immersive augmented reality, live display wall, head mounted display, video conferencing, and similar applications. In one implementation, the disclosed subject matter provides a complete view to a viewer by combining images captured by a camera array. In another implementation, the disclosed subject matter tracks the viewer's POV as he moves from one location to another and displays images in accordance with his varying POV. The change of the viewer's POV is inclusive of movements in the X, Y, and Z dimensions.

公开(公告)号：US10659757B2

公开(公告)日：2020-05-19

申请号：US16241294

申请日：2019-01-07

Applicant: Apple Inc.

Inventor： Ricardo J. Motta ,  Gary L. Vondran, Jr. ,  Manohar B. Srikanth ,  Brett D. Miller

IPC: H04N13/156 ,  H04N7/14 ,  G06F3/01 ,  H04N5/247 ,  H04N5/232 ,  H04N7/18 ,  H04N13/122 ,  H04N13/117 ,  H04N13/243

Abstract: This disclosure pertains to operations, systems, and computer readable media to capture images of a scene using a camera array and process the captured images based on a viewer's point of view (POV) for immersive augmented reality, live display wall, head mounted display, video conferencing, and similar applications. In one implementation, the disclosed subject matter provides a complete view to a viewer by combining images captured by a camera array. In another implementation, the disclosed subject matter tracks the viewer's POV as he moves from one location to another and displays images in accordance with his varying POV. The change of the viewer's POV is inclusive of movements in the X, Y, and Z dimensions.

公开(公告)号：US10178371B2

公开(公告)日：2019-01-08

申请号：US15588228

申请日：2017-05-05

Applicant: Apple Inc.

Inventor： Ricardo J. Motta ,  Gary L. Vondran, Jr. ,  Manohar B. Srikanth ,  Brett D. Miller

IPC: H04N7/15 ,  H04N13/156 ,  H04N7/14 ,  G06F3/01 ,  H04N5/247 ,  H04N5/232 ,  H04N13/117 ,  H04N13/243 ,  H04N7/18 ,  H04N13/122

Abstract: This disclosure pertains to operations, systems, and computer readable media to capture images of a scene using a camera array and process the captured images based on a viewer's point of view (POV) for immersive augmented reality, live display wall, head mounted display, video conferencing, and similar applications. In one implementation, the disclosed subject matter provides a complete view to a viewer by combining images captured by a camera array. In another implementation, the disclosed subject matter tracks the viewer's POV as he moves from one location to another and displays images in accordance with his varying POV. The change of the viewer's POV is inclusive of movements in the X, Y, and Z dimensions.

公开(公告)号：US12015758B1

公开(公告)日：2024-06-18

申请号：US17539524

申请日：2021-12-01

Applicant: Apple Inc.

Inventor： Gary L. Vondran, Jr. ,  Dan C. Lelescu ,  Robert K. Molholm ,  Nicolas V. Scapel ,  Kathrin Berkner-Cieslicki ,  Seung Wook Kim

IPC: H04N13/279 ,  H04N13/25 ,  H04N13/282 ,  H04N13/31 ,  H04N13/344

CPC classification number: H04N13/279 ,  H04N13/25 ,  H04N13/282 ,  H04N13/31 ,  H04N13/344

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide images for displaying a 3D appearance of a tracked object on a view dependent device. In some implementations, a set of multiple images of the object from different capture positions is provided and then adjusted such as to render the object in focus when using the adjusted images for display on the view dependent device. In some implementations, the set of multiple images is provided that includes virtual images generated using virtual image sensors that may improve the appearance of out of focus regions (e.g., outside the 3D object appearance) on the view dependent device. In some implementations, the set of multiple images of a person provides a hologram of the person (e.g., left and right eye views provide the appearance of a 3D person) where the images are adjusted to improve gaze direction of eyes of the person.

公开(公告)号：US11044398B2

公开(公告)日：2021-06-22

申请号：US16583176

申请日：2019-09-25

Applicant: Apple Inc.

Inventor： Gabriel D. Molina ,  Ricardo J. Motta ,  Gary L. Vondran, Jr. ,  Dan Lelescu ,  Tobias Rick ,  Brett Miller

IPC: H04N5/232 ,  H04N13/106 ,  G06T7/557 ,  H04N13/282 ,  H04N13/117 ,  G06T5/50 ,  G06T7/00 ,  G06T1/00

Abstract: A light field panorama system in which a user holding a mobile device performs a gesture to capture images of a scene from different positions. Additional information, for example position and orientation information, may also be captured. The images and information may be processed to determine metadata including the relative positions of the images and depth information for the images. The images and metadata may be stored as a light field panorama. The light field panorama may be processed by a rendering engine to render different 3D views of the scene to allow a viewer to explore the scene from different positions and angles with six degrees of freedom. Using a rendering and viewing system such as a mobile device or head-mounted display, the viewer may see behind or over objects in the scene, zoom in or out on the scene, or view different parts of the scene.