公开(公告)号：US20240062466A1

公开(公告)日：2024-02-22

申请号：US18207614

申请日：2023-06-08

Applicant: Tencent America LLC

Inventor： Ethan SCHUR ,  Xiaozhong XU ,  Shan LIU ,  Xiang ZHANG

IPC: G06T17/20

CPC classification number: G06T17/20

Abstract: Aspects of the disclosure provide methods and apparatuses for point cloud processing. In some examples, an apparatus for point cloud processing includes processing circuitry. For example, the processing circuitry obtains point cloud data corresponding to a point cloud in a three dimensional (3D) space, projects the point cloud in the 3D space to one or more two dimensional (2D) planes to generate one or more images. The processing circuitry generates a pixel wise mask for object instances in the point cloud according to the one or more images. The pixel wise mask includes first pixels that are associated with a first object instance in the point cloud. The processing circuitry processes the point cloud based on the pixel wise mask, a portion of the point cloud corresponding the first pixels in the pixel wise mask is processed based on one or more processing parameters determined for the first object instance.

公开(公告)号：US20240040148A1

公开(公告)日：2024-02-01

申请号：US18312338

申请日：2023-05-04

Applicant: TENCENT AMERICA LLC

Inventor： Thuong NGUYEN CANH ,  Xiang ZHANG ,  Xiaozhong XU ,  Shan LIU

IPC: H04N19/597 ,  H04N19/44 ,  H04N19/17 ,  H04N19/103

CPC classification number: H04N19/597 ,  H04N19/44 ,  H04N19/17 ,  H04N19/103

Abstract: A method and apparatus comprising computer code configured to cause a processor or processors to obtain an input mesh corresponding to volumetric data of at least one three-dimensional (3D) visual content, partitioning the input mesh into a plurality of submeshes, each of the submeshes comprising a respective one of instances of objects, determine a similarity between at least two of the instance of objects, grouping the submeshes based on the determined similarity, and code the volumetric data based on grouping the submeshes.

公开(公告)号：US20230388543A1

公开(公告)日：2023-11-30

申请号：US18127487

申请日：2023-03-28

Applicant: Tencent America LLC

Inventor： Jun TIAN ,  Chao HUANG ,  Xiang ZHANG ,  Xiaozhong XU ,  Shan LIU

IPC: H04N19/597 ,  H04N19/105 ,  H04N19/154 ,  H04N19/172 ,  H04N19/46

CPC classification number: H04N19/597 ,  H04N19/105 ,  H04N19/154 ,  H04N19/172 ,  H04N19/46

Abstract: A plurality of neighboring vertices of a current vertex in a current frame of a mesh is determined. The current frame corresponds to the mesh at a first time instance. Each of the plurality of neighboring vertices is connected to the current vertex through a respective edge in the mesh. A plurality of neighboring estimation errors of the plurality of neighboring vertices is determined. Each of the plurality of neighboring estimation errors indicates a difference between a reference vertex of a corresponding one of the plurality of neighboring vertices in a reference frame and the corresponding one of the plurality of neighboring vertices in the current frame. The reference frame corresponds to the mesh at a second time instance. A prediction residue of the current vertex is determined based on the plurality of neighboring estimation errors. Prediction information of the current vertex is generated based on the determined prediction residue.

公开(公告)号：US20230345046A1

公开(公告)日：2023-10-26

申请号：US18340274

申请日：2023-06-23

Applicant: TENCENT AMERICA LLC

Inventor： Xiang ZHANG ,  Wen GAO ,  Sehoon YEA ,  Shan LIU

IPC: H04N19/597 ,  H04N19/169 ,  H04N19/174

CPC classification number: H04N19/597 ,  H04N19/1883 ,  H04N19/174

Abstract: In a method for point cloud processing, a bitstream corresponding to a sequence of coded point cloud frames is received. Whether an implicit geometry partition is enabled for the sequence of coded point cloud frames is determined. An octree representing a geometry of points in a bounding box in a coded point cloud frame in the sequence of coded point cloud frames is reconstructed based on whether the implicit geometry partition is determined to be enabled for the sequence of coded point cloud frames.

公开(公告)号：US20230222697A1

公开(公告)日：2023-07-13

申请号：US17969570

申请日：2022-10-19

Applicant: Tencent America LLC

Inventor： Chao HUANG ,  Xiang ZHANG ,  Jun TIAN ,  Xiaozhong XU ,  Shan LIU

IPC: G06T9/00 ,  G06V10/44 ,  G06V10/24

CPC classification number: G06T9/001 ,  G06V10/24 ,  G06V10/457

Abstract: Aspects of the disclosure provide methods and apparatuses for mesh coding (encoding and/or decoding). In some examples, an apparatus for coding mesh includes processing circuitry. The processing circuitry decodes, three dimensional (3D) coordinates of vertices in a first 3D mesh frame and connectivity information of the vertices from a bitstream that carries the first 3D mesh frame. The first 3D mesh frame represents a surface of an object with polygons. The processing circuitry deduces texture coordinates associated with the vertices, and decodes a texture map for the first 3D mesh frame from the bitstream. The texture map includes first one or more 2D charts with 2D vertices having the texture coordinates. The processing circuitry reconstructs the first 3D mesh frame based on the 3D coordinates of the vertices, the connectivity information of the vertices, the texture map and the texture coordinates.

公开(公告)号：US20230014820A1

公开(公告)日：2023-01-19

申请号：US17862066

申请日：2022-07-11

Applicant: Tencent America LLC

Inventor： Xiang ZHANG ,  Chao HUANG ,  Shan LIU

IPC: G06T9/00 ,  G06T17/20 ,  G06T15/04

Abstract: Aspects of the disclosure provide methods and apparatuses for mesh coding (e.g., compression and decompression). In some examples, an apparatus for mesh coding includes processing circuitry. The processing circuitry decodes, using a point cloud compression (PCC) decoder and from a bitstream, a point cloud that includes points corresponding to at least one of vertices in a mesh or sampling points of polygons in the mesh. The processing circuitry determines, based on the point cloud, estimated connectivity information of the vertices in the mesh, and generate, a reconstructed mesh frame based on the point cloud and the estimated connectivity information.

公开(公告)号：US20230011096A1

公开(公告)日：2023-01-12

申请号：US17497326

申请日：2021-10-08

Applicant: TENCENT AMERICA LLC

Inventor： Xiang ZHANG ,  Wen Gao ,  Xiaozhong Xu ,  Shan Liu

IPC: H04N19/597 ,  H04N19/105 ,  H04N19/177 ,  H04N19/172

Abstract: Methods and apparatuses of encoding a video stream encoded using video point cloud coding include obtaining a plurality of frames including a first frame and remaining frames, wherein each frame of the plurality of frames is packed with a corresponding plurality of patches; grouping the remaining frames into a first group and a second group, wherein frames grouped into same group are temporally neighboring; processing the first frame; parallel processing frames in the first group after the first frame is processed; and generating an encoded video stream based on the processed first frame and the processed frames in the first group, wherein at least one frame of the first group depends from the first frame.

公开(公告)号：US20220394294A1

公开(公告)日：2022-12-08

申请号：US17496270

申请日：2021-10-07

Applicant: TENCENT AMERICA LLC

Inventor： Xiang ZHANG ,  Weiwei Feng ,  Wen Gao ,  Shan Liu ,  Bing Jian

IPC: H04N19/597 ,  H04N19/105 ,  H04N19/182 ,  H04N19/176 ,  G06T9/00

Abstract: Methods and apparatuses of encoding a video stream encoded using video point cloud coding include obtaining a source point cloud; generating an occupancy map including one or more pixels based on the source point cloud, an occupancy value associated with each pixel being a non-binary value; encoding the occupancy map to generate an encoded occupancy map, wherein a block of the encoded occupancy map corresponds to the one or more pixels of the occupancy map; selecting an occupancy value of the block based on the one or more pixels; and generating an encoded video stream based on the selected occupancy value.

公开(公告)号：US20220358671A1

公开(公告)日：2022-11-10

申请号：US17497025

申请日：2021-10-08

Applicant: TENCENT AMERICA LLC

Inventor： Xiang ZHANG ,  Bing JIAN ,  Lu HE ,  Haichao ZHU ,  Shan LIU ,  Kelin LIU ,  Weiwei FENG

IPC: G06T7/73

Abstract: A method, computer program, and computer system is provided for 3D pose graph reconstruction. 3D reconstruction of indoor buildings for VR/AR applications, such as virtual touring, digital museum, and virtual home sale, may be performed based on estimating pose graph and transformation matrix between cameras by recognizing markers on the ground in panorama images. Image data corresponding to one or more views of a first camera is received. One or more markers corresponding to a second camera are identified within the received image data. A pose graph corresponding to the one or more views of the first camera is constructed based on the identified one or more markers, the pose graph comprising at least an edge.

公开(公告)号：US20210248784A1

公开(公告)日：2021-08-12

申请号：US17084972

申请日：2020-10-30

Applicant: TENCENT AMERICA LLC

Inventor： Wen GAO ,  Xiang ZHANG ,  Shan LIU

IPC: G06T9/40 ,  G06T15/10

Abstract: A method and apparatus for coding information of a point cloud may be performed by at least one processor and comprises: obtaining the point cloud including a set of points in a three-dimensional space; partitioning the point cloud into a tree structure comprising a plurality of nodes at different depths; encoding geometry information of the nodes; and encoding attribute information of the nodes before the entire point cloud is partitioned.