THREE DIMENSIONAL MESH COMPRESSION USING A POINT CLOUD ENCODER

    公开(公告)号:WO2021062044A1

    公开(公告)日:2021-04-01

    申请号:PCT/US2020/052565

    申请日:2020-09-24

    Applicant: APPLE INC.

    Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.

    REFERENCE PICTURE MANAGEMENT AND LIST CONSTRUCTION

    公开(公告)号:WO2020131232A1

    公开(公告)日:2020-06-25

    申请号:PCT/US2019/059429

    申请日:2019-11-01

    Applicant: APPLE INC.

    Abstract: Techniques for encoding video with motion compensation include a compressed bitstream syntax that includes a list of all motion prediction reference frames without distinguishing between short-term reference frame and long-term reference frames. The list of reference frames may be provided in a slice header and may apply to encoded data video data within the corresponding slice. The list may be prefaced with a single number indicating the total number of reference frames. In an aspect delta POC reference numbers may be encoded with a flag indicating the sign of the delta POC when the absolute value of the POC is not equal to zero. In another aspect, a flag may be encoded for every reference frame indicating if POC information should be used when scaling prediction references, and a weighting parameter may be included when POC information should be used.

    ENCODING AND DECODING VISUAL CONTENT INCLUDING POLYGONAL MESHES

    公开(公告)号:WO2023039507A1

    公开(公告)日:2023-03-16

    申请号:PCT/US2022/076168

    申请日:2022-09-09

    Applicant: APPLE INC.

    Abstract: In an example method, a system obtains first data representing a plurality of polygons of a polygon mesh, and performs several operations for each of the polygons, including (i) determining a number of sample points for that polygon, where the number of sample points is determined based on at least one of an area of that polygon or an area of the polygon mesh, (ii) determining a distribution of the sample points for that polygon, and (iii) sampling the polygon mesh in accordance with the determined number of sample points and the determined distribution of sample points, where sampling the polygon mesh includes determining one or more characteristics of the polygon mesh at each of the sample points. The system also outputs second data representing the one or more characteristics of the polygon mesh at one or more of the sample points.

    POINT CLOUD COMPRESSION WITH SUPPLEMENTAL INFORMATION MESSAGES

    公开(公告)号:WO2021003229A1

    公开(公告)日:2021-01-07

    申请号:PCT/US2020/040438

    申请日:2020-07-01

    Applicant: APPLE INC.

    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image-based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image-based representation of a point cloud. Additionally, an encoder is configured to signal and/or a decoder is configured to receive a supplementary message comprising volumetric tiling information that maps portions of 2D image representations to objects in the point. In some embodiments, characteristics of the object may additionally be signaled using the supplementary message or additional supplementary messages.

    VIDEO-BASED POINT CLOUD COMPRESSION WITH NON-NORMATIVE SMOOTHING

    公开(公告)号:WO2021062289A1

    公开(公告)日:2021-04-01

    申请号:PCT/US2020/052900

    申请日:2020-09-25

    Applicant: APPLE INC.

    Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder applies an attribute transfer function to attributes of an image based representation with out-of-loop smoothing such that a decoder may apply any smoothing filter supported by the decoder without being restricted to using a similar smoothing filter as the encoder.

    POINT CLOUD COMPRESSION USING VIDEO ENCODING WITH TIME CONSISTENT PATCHES

    公开(公告)号:WO2021062274A1

    公开(公告)日:2021-04-01

    申请号:PCT/US2020/052882

    申请日:2020-09-25

    Applicant: APPLE INC.

    Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder generates time-consistent patches for multiple version of the point cloud at multiple moments in time and uses the time- consistent patches to generate image based representations of the point cloud at the multiple moments in time.

    POINT CLOUD COMPRESSION USING A SPACE FILLING CURVE FOR LEVEL OF DETAIL GENERATION

    公开(公告)号:WO2020146539A1

    公开(公告)日:2020-07-16

    申请号:PCT/US2020/012794

    申请日:2020-01-08

    Applicant: APPLE INC.

    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. An order for the points is determined based on a space filling curve, wherein an encoder and a decoder determine a same order for the points based on the space filling curve. Levels of detail are determined by sampling the ordered points according to different sampling parameters, and attribute values are predicted for the points in the levels of detail using the determined order. The encoder determines attribute correction values based on a comparison of the predicted values to an original value prior to compression. The decoder corrects the predicted attribute values based on received attribute correction values.

Patent Agency Ranking