公开(公告)号：US20220358671A1

公开(公告)日：2022-11-10

申请号：US17497025

申请日：2021-10-08

Applicant: TENCENT AMERICA LLC

Inventor： Xiang ZHANG ,  Bing JIAN ,  Lu HE ,  Haichao ZHU ,  Shan LIU ,  Kelin LIU ,  Weiwei FENG

IPC: G06T7/73

Abstract: A method, computer program, and computer system is provided for 3D pose graph reconstruction. 3D reconstruction of indoor buildings for VR/AR applications, such as virtual touring, digital museum, and virtual home sale, may be performed based on estimating pose graph and transformation matrix between cameras by recognizing markers on the ground in panorama images. Image data corresponding to one or more views of a first camera is received. One or more markers corresponding to a second camera are identified within the received image data. A pose graph corresponding to the one or more views of the first camera is constructed based on the identified one or more markers, the pose graph comprising at least an edge.

公开(公告)号：US20240386528A1

公开(公告)日：2024-11-21

申请号：US18666438

申请日：2024-05-16

Applicant: TENCENT AMERICA LLC

Inventor： Lu HE ,  Haozheng YU ,  Haichao ZHU ,  Kelin LIU ,  Weiwei FENG ,  Xiaozhong XU ,  Shan LIU

IPC: G06T5/60 ,  G06T3/4038 ,  G06T3/4046 ,  G06T5/50 ,  G06T5/80

Abstract: This disclosure relates generally to image processing and specifically to processing panorama images using neural networks to generate depth maps, layouts, semantic maps or the like with reduced distortion and improved continuity. Methods and systems are described for generating such maps by leveraging several essential properties of these panorama images and by using a panorama panel representation and a neural network framework. A panel geometry embedding network is incorporated for encoding both the local and global geometric features of the panels in order to reduce negative impact of panoramic distortion. A local-to-global transformer network is also incorporated for capturing geometric context and aggregating local information within a panel and panel-wise global context.

公开(公告)号：US20220358694A1

公开(公告)日：2022-11-10

申请号：US17502520

申请日：2021-10-15

Applicant: TENCENT AMERICA LLC

Inventor： Xiang ZHANG ,  Bing JIAN ,  Lu HE ,  Haichao ZHU ,  Shan LIU ,  Kelin LIU ,  Weiwei FENG

IPC: G06T11/20 ,  G06T19/00 ,  G06T7/60

Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for generating a floor plan from a point cloud model. An apparatus includes processing circuitry that receives an input three-dimensional point cloud corresponding to a three-dimensional space. The processing circuitry determines a plurality of wall planes in the received input three-dimensional point cloud. The processing circuitry generates a plurality of line segments. Each line segment is generated by projecting a respective wall plane of the plurality of wall planes to a floor plane in the three-dimensional space. The processing circuitry represents the plurality of wall planes in the three-dimensional space using the plurality of line segments in a two-dimensional space corresponding to the floor plan. The processing circuitry adjusts the plurality of line segments in the two-dimensional space to improve the floor plan. The processing circuitry generates the floor plan based on the plurality of adjusted line segments.

公开(公告)号：US20230245390A1

公开(公告)日：2023-08-03

申请号：US17981156

申请日：2022-11-04

Applicant: Tencent America LLC

Inventor： Haichao ZHU ,  Bing JIAN ,  Weiwei FENG ,  Lu HE ,  Kelin LIU ,  Shan LIU

IPC: G06T17/20 ,  G06T7/60 ,  G06V10/764 ,  G06T7/55 ,  G06V20/70 ,  G06T7/33 ,  G06T11/20 ,  G06T15/06

CPC classification number: G06T17/20 ,  G06T7/60 ,  G06V10/764 ,  G06T7/55 ,  G06V20/70 ,  G06T7/33 ,  G06T11/203 ,  G06T15/06

Abstract: A plurality of two-dimensional (2D) images of the scene is received. Geometric information and semantic information of each of the plurality of 2D images is determined. The geometric information indicates a detected line and a reference direction in the respective 2D image. The semantic information includes classification information of pixels in the respective 2D image. A layout estimation associated with the respective 2D image of the scene is determined based on the geometric information and the semantic information of the respective 2D image. A combined layout estimation associated with the scene is determined based on a plurality of the determined layout estimations associated with the plurality of 2D images of the scene. The Manhattan layout associated with the scene is generated based on the combined layout estimation. The Manhattan layout includes at least a three-dimensional (3D) shape of the scene that includes wall faces orthogonal with respect to each other.