Invention Grant
- Patent Title: Real-time mobile device capture and generation of AR/VR content
-
Application No.: US15428104Application Date: 2017-02-08
-
Publication No.: US10719939B2Publication Date: 2020-07-21
- Inventor: Stefan Johannes Josef Holzer , Yuheng Ren , Abhishek Kar , Alexander Jay Bruen Trevor , Krunal Ketan Chande , Martin Josef Nikolaus Saelzle , Radu Bogdan Rusu
- Applicant: Fyusion, Inc.
- Applicant Address: US CA San Francisco
- Assignee: Fyusion, Inc.
- Current Assignee: Fyusion, Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Kwan & Olynick LLP
- Main IPC: G06T15/00
- IPC: G06T15/00 ; G06T7/174 ; H04N13/282 ; H04N13/243 ; H04N5/265 ; H04N5/232 ; G06F16/532 ; H04N13/279 ; G06F3/01 ; G06F16/583 ; G06F16/738 ; G06T3/40 ; G06F16/783 ; G06K9/00

Abstract:
Various embodiments describe systems and processes for generating AR/VR content. In one aspect, a method for generating a three-dimensional (3D) projection of an object is provided. A sequence of images along a camera translation may be obtained using a single lens camera. Each image contains at least a portion of overlapping subject matter, which includes the object. The object is semantically segmented from the sequence of images using a trained neural network to form a sequence of segmented object images, which are then refined using fine-grained segmentation. On-the-fly interpolation parameters are computed and stereoscopic pairs are generated for points along the camera translation from the refined sequence of segmented object images for displaying the object as a 3D projection in a virtual reality or augmented reality environment. Segmented image indices are then mapped to a rotation range for display in the virtual reality or augmented reality environment.
Public/Granted literature
- US20170148223A1 REAL-TIME MOBILE DEVICE CAPTURE AND GENERATION OF AR/VR CONTENT Public/Granted day:2017-05-25
Information query
IPC分类:
G | 物理 |
G06 | 计算;推算或计数 |
G06T | 一般的图像数据处理或产生 |
G06T15/00 | 3D〔三维〕图像的加工 |