公开(公告)号：US20220358694A1

公开(公告)日：2022-11-10

申请号：US17502520

申请日：2021-10-15

Applicant: TENCENT AMERICA LLC

Inventor： Xiang ZHANG ,  Bing JIAN ,  Lu HE ,  Haichao ZHU ,  Shan LIU ,  Kelin LIU ,  Weiwei FENG

IPC: G06T11/20 ,  G06T19/00 ,  G06T7/60

Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for generating a floor plan from a point cloud model. An apparatus includes processing circuitry that receives an input three-dimensional point cloud corresponding to a three-dimensional space. The processing circuitry determines a plurality of wall planes in the received input three-dimensional point cloud. The processing circuitry generates a plurality of line segments. Each line segment is generated by projecting a respective wall plane of the plurality of wall planes to a floor plane in the three-dimensional space. The processing circuitry represents the plurality of wall planes in the three-dimensional space using the plurality of line segments in a two-dimensional space corresponding to the floor plan. The processing circuitry adjusts the plurality of line segments in the two-dimensional space to improve the floor plan. The processing circuitry generates the floor plan based on the plurality of adjusted line segments.

公开(公告)号：US20220358671A1

公开(公告)日：2022-11-10

申请号：US17497025

申请日：2021-10-08

Applicant: TENCENT AMERICA LLC

Inventor： Xiang ZHANG ,  Bing JIAN ,  Lu HE ,  Haichao ZHU ,  Shan LIU ,  Kelin LIU ,  Weiwei FENG

IPC: G06T7/73

Abstract: A method, computer program, and computer system is provided for 3D pose graph reconstruction. 3D reconstruction of indoor buildings for VR/AR applications, such as virtual touring, digital museum, and virtual home sale, may be performed based on estimating pose graph and transformation matrix between cameras by recognizing markers on the ground in panorama images. Image data corresponding to one or more views of a first camera is received. One or more markers corresponding to a second camera are identified within the received image data. A pose graph corresponding to the one or more views of the first camera is constructed based on the identified one or more markers, the pose graph comprising at least an edge.

公开(公告)号：US20230281921A1

公开(公告)日：2023-09-07

申请号：US17982945

申请日：2022-11-08

Applicant: TENCENT AMERICA LLC

Inventor： Dan MIAO ,  Bing JIAN ,  Weiwei FENG ,  Shan LIU ,  Ye WANG

IPC: G06T17/00 ,  G06T13/40 ,  G06T7/194 ,  G06T7/30 ,  G06T7/40 ,  G06V10/74

CPC classification number: G06T17/00 ,  G06T13/40 ,  G06T7/194 ,  G06T7/30 ,  G06T7/40 ,  G06V10/761 ,  G06T2207/30196

Abstract: A method for 3D human model reconstruction and animation includes receiving a two-dimensional (2D) image of a human, segmenting the 2D image into a foreground with the human and a background without the human in the 2D image, generating a parametric model comprising a pose, a shape, and one or more rigging parameters based on the human in the foreground, predicting a textured three-dimensional (3D) model using implicit surface reconstruction of the human in the foreground, aligning the parametric model and the textured 3D model using a 3D registration, and generating a textured 3D clothed human model based on the aligned parametric model and the predicted textured 3D model.

公开(公告)号：US20220116642A1

公开(公告)日：2022-04-14

申请号：US17560831

申请日：2021-12-23

Applicant: TENCENT AMERICA LLC

Inventor： Byeongdoo CHOI ,  Weiwei FENG ,  Shan LIU

IPC: H04N19/51 ,  H04N19/119 ,  H04N19/17 ,  H04N19/70 ,  H04N19/46

Abstract: Reconstructing a coded current picture for video decoding including decoding picture partitioning information corresponding to the current picture; determining whether padding is applied to sub-regions of the current picture using the picture partitioning information; based on determining that padding is not applied, decoding the sub-regions without padding the sub-regions; based on determining that padding is applied, determining whether the padding includes wrap-around padding using the picture partitioning information; based on determining that the padding does not include wrap-around padding, applying repetition padding to the sub-regions, and decoding the sub-regions using the repetition padding; based on determining that the padding includes wrap-around padding, applying the wrap-around padding to the sub-regions, and decoding the sub-regions using the wrap-around padding; and reconstructing the current picture based on the decoded sub-regions.

公开(公告)号：US20230245390A1

公开(公告)日：2023-08-03

申请号：US17981156

申请日：2022-11-04

Applicant: Tencent America LLC

Inventor： Haichao ZHU ,  Bing JIAN ,  Weiwei FENG ,  Lu HE ,  Kelin LIU ,  Shan LIU

IPC: G06T17/20 ,  G06T7/60 ,  G06V10/764 ,  G06T7/55 ,  G06V20/70 ,  G06T7/33 ,  G06T11/20 ,  G06T15/06

CPC classification number: G06T17/20 ,  G06T7/60 ,  G06V10/764 ,  G06T7/55 ,  G06V20/70 ,  G06T7/33 ,  G06T11/203 ,  G06T15/06

Abstract: A plurality of two-dimensional (2D) images of the scene is received. Geometric information and semantic information of each of the plurality of 2D images is determined. The geometric information indicates a detected line and a reference direction in the respective 2D image. The semantic information includes classification information of pixels in the respective 2D image. A layout estimation associated with the respective 2D image of the scene is determined based on the geometric information and the semantic information of the respective 2D image. A combined layout estimation associated with the scene is determined based on a plurality of the determined layout estimations associated with the plurality of 2D images of the scene. The Manhattan layout associated with the scene is generated based on the combined layout estimation. The Manhattan layout includes at least a three-dimensional (3D) shape of the scene that includes wall faces orthogonal with respect to each other.

公开(公告)号：US20240386528A1

公开(公告)日：2024-11-21

申请号：US18666438

申请日：2024-05-16

Applicant: TENCENT AMERICA LLC

Inventor： Lu HE ,  Haozheng YU ,  Haichao ZHU ,  Kelin LIU ,  Weiwei FENG ,  Xiaozhong XU ,  Shan LIU

IPC: G06T5/60 ,  G06T3/4038 ,  G06T3/4046 ,  G06T5/50 ,  G06T5/80

Abstract: This disclosure relates generally to image processing and specifically to processing panorama images using neural networks to generate depth maps, layouts, semantic maps or the like with reduced distortion and improved continuity. Methods and systems are described for generating such maps by leveraging several essential properties of these panorama images and by using a panorama panel representation and a neural network framework. A panel geometry embedding network is incorporated for encoding both the local and global geometric features of the panels in order to reduce negative impact of panoramic distortion. A local-to-global transformer network is also incorporated for capturing geometric context and aggregating local information within a panel and panel-wise global context.

公开(公告)号：US20220094979A1

公开(公告)日：2022-03-24

申请号：US17409526

申请日：2021-08-23

Applicant: TENCENT AMERICA LLC

Inventor： Jun TIAN ,  Shan LIU ,  Xiaozhong XU ,  Weiwei FENG ,  Wen GAO

IPC: H04N19/597 ,  H04N19/167 ,  H04N19/176 ,  H04N19/159 ,  H04N19/105

Abstract: A method, computer program, and computer system is provided for coding video data. Video data including a reference view and a current view is received. A co-located block in the reference view is identified for a current block in the current view. A predicted block vector is calculated based on an offset vector between the current block and the co-located block, and a disparity vector between the co-located block and the reference block in the reference view. The video data is encoded/decoded based on the calculated predicted block vector.

公开(公告)号：US20220094978A1

公开(公告)日：2022-03-24

申请号：US17026922

申请日：2020-09-21

Applicant: TENCENT AMERICA LLC

Inventor： Jun TIAN ,  Shan LIU ,  Xiaozhong XU ,  Weiwei FENG

IPC: H04N19/597 ,  H04N19/52 ,  H04N19/105 ,  H04N19/176 ,  H04N19/172 ,  H04N19/577 ,  H04N19/61 ,  H04N19/167 ,  H04N19/139

Abstract: A method, computer program, and computer system is provided for coding video data. Video data including (1) a first frame comprising a first current view and a first reference view and (2) a second frame comprising a second current view and a second reference view is received. A co-located block in the first reference view is identified for a current block in the first current view. A predicted offset vector is calculated based on the motion vector between the co-located block and its reference block in the second reference view. The video data is encoded/decoded based on the predicted offset vector.