-
公开(公告)号:US20240104872A1
公开(公告)日:2024-03-28
申请号:US18371243
申请日:2023-09-21
Applicant: Apple Inc.
Inventor: Bryce L. Schmidtchen , Bryan Cline , Charles O. Goddard , Michael I. Weinstein , Tsao-Wei Huang , Tobias Rick , Vedant Saran , Alexander Menzies , Alexandre Da Veiga
CPC classification number: G06T19/20 , G06T5/002 , G06T15/04 , G06T15/10 , G06T19/006 , G06T2219/2004
Abstract: Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.
-
公开(公告)号:US11875455B2
公开(公告)日:2024-01-16
申请号:US18095180
申请日:2023-01-10
Applicant: Apple Inc.
Inventor: Rafael Saracchini , Tobias Rick , Zachary Z. Becker
CPC classification number: G06T17/00 , G06T7/20 , G06T7/579 , G06T19/006 , H04N23/633 , H04N23/64 , G06T2200/24 , G06T2207/10028 , G06T2207/30168 , G06T2207/30244
Abstract: Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model based on a selected subset of the images and depth data corresponding to each of the images of the subset. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment captured via a camera on the device, selecting a subset of the images based on assessing the images with respect to motion-based defects based on device motion and depth data, and generating a 3D model of the object based on the selected subset of the images and depth data corresponding to each of the images of the selected subset.
-
公开(公告)号:US20230419593A1
公开(公告)日:2023-12-28
申请号:US18244355
申请日:2023-09-11
Applicant: Apple Inc.
Inventor: Alexandre Da Veiga , Tobias Rick , Timothy R. Pease
CPC classification number: G06T15/20 , G06T7/593 , G06F3/013 , G06T19/006 , G06T2200/24
Abstract: Various implementations disclosed herein include devices, systems, and methods that present views of media objects using different viewing states determined based on context. In some implementations, a view of a 3D environment is presented. Then, a context associated with viewing one or more media objects within the 3D environment is determined, the media objects associated with data for providing an appearance of depth within the one or more media objects. Based on the context, a viewing state is determined for viewing a media object of the one or more media objects within the 3D environment, the viewing state defining whether the media object will be presented as a planar object or with depth within the media object. In accordance with a determination that the viewing state is a first viewing state, the media object is presented within the 3D environment using its associated data for providing the appearance of depth.
-
公开(公告)号:US20210264664A1
公开(公告)日:2021-08-26
申请号:US17171434
申请日:2021-02-09
Applicant: Apple Inc.
Inventor: Rafael Saracchini , Tobias Rick , Zachary Z. Becker
Abstract: Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model based on a selected subset of the images and depth data corresponding to each of the images of the subset. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment captured via a camera on the device, selecting a subset of the images based on assessing the images with respect to motion-based defects based on device motion and depth data, and generating a 3D model of the object based on the selected subset of the images and depth data corresponding to each of the images of the selected subset.
-
公开(公告)号:US12206830B2
公开(公告)日:2025-01-21
申请号:US18661336
申请日:2024-05-10
Applicant: Apple Inc.
Inventor: Alexander Menzies , Tobias Rick , Alexandre Da Veiga , Bryce L Schmidtchen , Vedant Saran , Bryan Cline , Michael I Weinstein , Tsao-Wei Huang
Abstract: Embodiments disclosed herein are directed to devices, systems, and methods for separately processing an image stream to generate a first set of images for display by a set of displays and a second set of images for storage or transfer as part of a media capture event. Specifically, a first set of images from an image stream may be used to generate a first set of transformed images, and these transformed images may be displayed on a set of displays. A second set of images may be selected from the image stream in response to a capture request associated with a media capture event, and the second set of images may be used to generate a second set of transformed images. A set of output images may be generated from the second set of transformed images, and the set of output images may be stored or transmitted for later viewing.
-
公开(公告)号:US20240355081A1
公开(公告)日:2024-10-24
申请号:US18760288
申请日:2024-07-01
Applicant: Apple Inc.
Inventor: Bryce L. Schmidtchen , Bryan Cline , Charles O. Goddard , Michael I. Weinstein , Tsao-Wei Huang , Tobias Rick , Vedant Saran , Alexander Menzies , Alexandre Da Veiga
CPC classification number: G06T19/20 , G06T5/70 , G06T15/04 , G06T15/10 , G06T19/006 , G06T2219/2004
Abstract: Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.
-
公开(公告)号:US20240062488A1
公开(公告)日:2024-02-22
申请号:US18385943
申请日:2023-11-01
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Chen Huang , Onur C. Hamsici , Shuo Feng , Hao Tang , Tobias Rick
CPC classification number: G06T19/006 , G06T7/20 , G06F9/453 , G06F3/04815 , G06V20/10 , G06V20/64
Abstract: Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model of an object based on images and tracked positions of a device during acquisition of the images. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment acquired via a camera on the device, identifying the object in at least some of the images, tracking positions of the device during acquisition of the images based on identifying the object in the at least some of the images, the positions identifying positioning of the device with respect to a coordinate system defined based on a position and orientation of the object, and generating a 3D model of the object based on the images and positions of the device during acquisition of the images.
-
公开(公告)号:US20230403386A1
公开(公告)日:2023-12-14
申请号:US18238750
申请日:2023-08-28
Applicant: Apple Inc.
Inventor: Alexandre Da Veiga , Tobias Rick
IPC: H04N13/282 , H04N13/383 , H04N13/128 , H04N13/261
CPC classification number: H04N13/282 , H04N13/383 , H04N13/128 , H04N13/261 , H04N13/332
Abstract: Various implementations disclosed herein include devices, systems, and methods that provides a view of a three-dimensional (3D) environment that includes a projection of a 3D image, such as a multi-directional stereo image or video content. For example, an example process may include obtaining a three-dimensional (3D) image including a stereoscopic image pair including left eye content corresponding to a left eye viewpoint and right eye content corresponding to a right eye viewpoint, generating a projection of the 3D image within a 3D environment by projecting portions of the 3D image to form a shape within the 3D environment, the shape based on an angle of view of the 3D image, where the 3D environment includes additional content separate from the 3D image, and providing a view of the 3D environment including the projection of the 3D image.
-
公开(公告)号:US20210279967A1
公开(公告)日:2021-09-09
申请号:US17179487
申请日:2021-02-19
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Chen Huang , Onur C. Hamsici , Shuo Feng , Hao Tang , Tobias Rick
IPC: G06T19/00 , G06T7/20 , G06K9/00 , G06F3/0481 , G06F9/451
Abstract: Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model of an object based on images and tracked positions of a device during acquisition of the images. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment acquired via a camera on the device, identifying the object in at least some of the images, tracking positions of the device during acquisition of the images based on identifying the object in the at least some of the images, the positions identifying positioning of the device with respect to a coordinate system defined based on a position and orientation of the object, and generating a 3D model of the object based on the images and positions of the device during acquisition of the images.
-
公开(公告)号:US20240414308A1
公开(公告)日:2024-12-12
申请号:US18680478
申请日:2024-05-31
Applicant: Apple Inc.
Inventor: Tobias Rick , Alexandre Da Veiga , Alexander Menzies , Vladlen Koltun , Vicki M Murley , Dean Jackson , Chelsea E Pugh , Alexa Rockwell
IPC: H04N13/261 , H04N13/344 , H04N13/351 , H04N13/383
Abstract: Various implementations disclosed herein include devices, systems, and methods that dynamically apply a 3D effect to a 2D asset. For example, a process may obtain an image depicting two-dimensional (2D) content. The process may further determine to apply a three-dimensional (3D) effect to the image via a head mounted device (HMD). The process may further, in accordance with determining to apply the 3D effect to the image, present a view of a 3D environment including the image. The image may be positioned at a location within the 3D environment and the view may depict the image using the 3D effect.
-
-
-
-
-
-
-
-
-