公开(公告)号：US20240397025A1

公开(公告)日：2024-11-28

申请号：US18691424

申请日：2022-09-22

Applicant: Apple Inc.

Inventor： Kai Berger ,  Dan C Lelescu ,  Tobias Rick

IPC: H04N13/128 ,  G06T5/70 ,  G06T5/77 ,  G06T7/593 ,  H04N13/239 ,  H04N13/344

Abstract: Methods and apparatus for providing an expanded field of view (FoV) using multiple cameras of a device. A device may include front-facing cameras that capture views of an environment, as well as side cameras that capture wider-angle views. Images from the front and side cameras may be processed to provide a stereo view of the environment with an expanded FoV. Images from the front cameras are processed to provide stereo images, and depth information is generated from the stereo images. The depth information is expanded into a second layer, and a median depth is set for a third layer. The side camera images are undistorted, pixel information from the side camera images is then reprojected into the second and third layers, and the second and third layers are blurred.

公开(公告)号：US12051170B2

公开(公告)日：2024-07-30

申请号：US18371243

申请日：2023-09-21

Applicant: Apple Inc.

Inventor： Bryce L. Schmidtchen ,  Bryan Cline ,  Charles O. Goddard ,  Michael I. Weinstein ,  Tsao-Wei Huang ,  Tobias Rick ,  Vedant Saran ,  Alexander Menzies ,  Alexandre Da Veiga

IPC: G06T19/20 ,  G06T5/70 ,  G06T15/04 ,  G06T15/10 ,  G06T19/00

CPC classification number: G06T19/20 ,  G06T5/70 ,  G06T15/04 ,  G06T15/10 ,  G06T19/006 ,  G06T2219/2004

Abstract: Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.

公开(公告)号：US11935187B2

公开(公告)日：2024-03-19

申请号：US18095180

申请日：2023-01-10

Applicant: Apple Inc.

Inventor： Rafael Saracchini ,  Tobias Rick ,  Zachary Z. Becker

IPC: G06T17/00 ,  G06T7/20 ,  G06T7/579 ,  G06T19/00 ,  H04N23/60 ,  H04N23/63

CPC classification number: G06T17/00 ,  G06T7/20 ,  G06T7/579 ,  G06T19/006 ,  H04N23/633 ,  H04N23/64 ,  G06T2200/24 ,  G06T2207/10028 ,  G06T2207/30168 ,  G06T2207/30244

Abstract: Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model based on a selected subset of the images and depth data corresponding to each of the images of the subset. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment captured via a camera on the device, selecting a subset of the images based on assessing the images with respect to motion-based defects based on device motion and depth data, and generating a 3D model of the object based on the selected subset of the images and depth data corresponding to each of the images of the selected subset.

公开(公告)号：US20240007607A1

公开(公告)日：2024-01-04

申请号：US18367660

申请日：2023-09-13

Applicant: Apple Inc.

Inventor： Alexandre Da Veiga ,  Alexander Menzies ,  Tobias Rick

IPC: H04N13/275 ,  G06T17/00 ,  H04N13/344 ,  H04N13/351 ,  H04N13/383

CPC classification number: H04N13/275 ,  G06T17/00 ,  H04N13/344 ,  H04N13/351 ,  H04N13/383 ,  H04N2013/0081

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine and provide a transition (optionally including a transition effect) between different types of views of three-dimensional (3D) content. For example, an example process may include obtaining a 3D content item, providing a first view of the 3D content item within a 3D environment, determining to transition from the first view to a second view of the 3D content item based on a criterion, and providing the second view of the 3D content item within the 3D environment, where the left eye view and the right eye view of the 3D content item are based on at least one of the left eye content and the right eye content.

公开(公告)号：US20180082482A1

公开(公告)日：2018-03-22

申请号：US15711992

申请日：2017-09-21

Applicant: Apple Inc.

Inventor： Ricardo J. Motta ,  Brett D. Miller ,  Tobias Rick ,  Manohar B. Srikanth

IPC: G06T19/00 ,  H04N13/04 ,  G02B27/01

CPC classification number: G06T19/006 ,  G02B27/0093 ,  G02B27/0172 ,  G02B2027/0136 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0187 ,  G06F1/163 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/015 ,  G06F3/017 ,  H04N13/344 ,  H04N13/383

Abstract: A mixed reality system that includes a head-mounted display (HMD) that provides 3D virtual views of a user's environment augmented with virtual content. The HMD may include sensors that collect information about the user's environment (e.g., video, depth information, lighting information, etc.), and sensors that collect information about the user (e.g., the user's expressions, eye movement, hand gestures, etc.). The sensors provide the information as inputs to a controller that renders frames including virtual content based at least in part on the inputs from the sensors. The HMD may display the frames generated by the controller to provide a 3D virtual view including the virtual content and a view of the user's environment for viewing by the user.