公开(公告)号：US20220070493A1

公开(公告)日：2022-03-03

申请号：US17523826

申请日：2021-11-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/85 ,  H04N19/463

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.

公开(公告)号：US11202078B2

公开(公告)日：2021-12-14

申请号：US17031782

申请日：2020-09-24

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Khaled Mammou ,  Liviu Traian Christian Tulvan ,  Marius Preda

IPC: H04N19/139 ,  H04N19/107 ,  G06T9/00 ,  H04N19/96 ,  H04N19/147 ,  H04N19/172

Abstract: A system comprises an encoder configured to compress attribute information for a dynamic point cloud and/or a decoder configured to decompress compressed attribute information for a dynamic point cloud. The dynamic point cloud may include multiple versions of the point cloud at multiple moments in time Attribute values for the point cloud may be compressed at a reference frame using an intra-prediction process and may be compressed at one or more reference frames using an inter-prediction process that takes advantage of temporal relationships between different frames (e.g. versions) of the dynamic point cloud at the different moments in time.

公开(公告)号：US20210211724A1

公开(公告)日：2021-07-08

申请号：US17145192

申请日：2021-01-08

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Khaled Mammou ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/46 ,  H04N19/30 ,  H04N19/124

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for volumetric visual content and/or a decoder configured to decompress compressed attribute and/or spatial information for the volumetric visual content. The encoder is configured to convert a 3D representation of the visual volumetric content into a 2D image based representation. The encoder is further configured to scale the patch in 2D space independent of any scaling in 3D space. Auxiliary information is signaled for use in identifying 2D scaled or unscaled patches in an image frame, mapping the patches into 3D space, and adjusting for any scaling factors applied at the encoder.

公开(公告)号：US11017566B1

公开(公告)日：2021-05-25

申请号：US16459483

申请日：2019-07-01

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T3/40 ,  H03M7/30 ,  G06T17/20

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.

公开(公告)号：US20210136370A1

公开(公告)日：2021-05-06

申请号：US16834611

申请日：2020-03-30

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  David W. Singer ,  Dominik Mehlem ,  Krishnakanth Rapaka

IPC: H04N19/119 ,  H04N19/159 ,  H04N19/139 ,  H04N19/176 ,  H04N19/573 ,  H04N19/543

Abstract: Techniques for coding and decoding video may include predicting picture regions defined by a time-varying tessellation and/or by a tessellation that varies spatially within a picture. These techniques improve decoded video quality, for example, by reducing block-based visual artifacts. Tessellation patterns may be irregular spatially to prevent alignment of some prediction region boundaries within a picture. Tessellation patterns may vary over time based on a spatial offset value, and the spatial offset value may be determined via a modulo function. Tessellation patterns may include overlapped shapes, for example when used in conjunction with overlapped block motion compensation.

公开(公告)号：US10999583B2

公开(公告)日：2021-05-04

申请号：US16132219

申请日：2018-09-14

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: H04N19/29 ,  H04N19/103 ,  G09G5/14 ,  H04N21/44

Abstract: Aspects of the present disclosure provide techniques for reducing latency and improving image quality of a viewport extracted from multi-directional video communications. According to such techniques, first streams of coded video data are received from a source. The first streams include coded data for each of a plurality of tiles representing a multi-directional video, where each tile corresponding to a predetermined spatial region of the multi-directional video, and at least one tile of the plurality of tiles in the first streams contains a current viewport location at a receiver. The techniques include decoding the first streams and displaying the tile containing the current viewport location. When the viewport location at the receiver changes to include a new tile of the plurality of tiles, retrieving and decoding first streams for the new tile, displaying the decoded content for the changed viewport location, and transmitting the changed viewport location to the source.

公开(公告)号：US20210099701A1

公开(公告)日：2021-04-01

申请号：US17031792

申请日：2020-09-24

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Khaled Mammou ,  Dominik Mehlem

IPC: H04N19/117 ,  H04N19/60 ,  H04N19/80 ,  H04N19/136 ,  H04N19/12 ,  H04N19/172 ,  H04N19/184

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder applies an attribute transfer function to attributes of an image based representation with out-of-loop smoothing such that a decoder may apply any smoothing filter supported by the decoder without being restricted to using a similar smoothing filter as the encoder.

公开(公告)号：US20210097723A1

公开(公告)日：2021-04-01

申请号：US17031787

申请日：2020-09-24

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou ,  Chao Cao ,  Marius Preda

IPC: G06T9/00 ,  G06T5/00 ,  G06T7/73 ,  H04N19/137 ,  H04N19/60 ,  H04N19/80 ,  H04N19/172

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder generates time-consistent patches for multiple version of the point cloud at multiple moments in time and uses the time-consistent patches to generate image based representations of the point cloud at the multiple moments in time.

公开(公告)号：US20210012536A1

公开(公告)日：2021-01-14

申请号：US17032711

申请日：2020-09-25

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T7/20 ,  G06T7/50 ,  H04N19/172

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder is configured project the point cloud on to patch planes to compress the point cloud, and supports multiple layered patch planes. For example, some point clouds may have a depth, and points at different depths may be assigned to different layered patch planes.

公开(公告)号：US10853973B2

公开(公告)日：2020-12-01

申请号：US16592711

申请日：2019-10-03

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Khaled Mammou ,  Jungsun Kim ,  Yeping Su

IPC: G06T9/00

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. In order to improve computing efficiency and/or repeatability, fixed-point number representations are used when determining predicted attribute values and attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file using fixed-point number representations.