PROCESSING OF EQUIRECTANGULAR OBJECT DATA TO COMPENSATE FOR DISTORTION BY SPHERICAL PROJECTIONS

    公开(公告)号:WO2018151978A1

    公开(公告)日:2018-08-23

    申请号:PCT/US2018/017124

    申请日:2018-02-06

    Applicant: APPLE INC.

    Abstract: Multi-directional image data often contains distortions of image content that cause problems when processed by video coders that are designed to process traditional, "flat" image content. Embodiments of the present disclosure provide techniques for coding multi-directional image data using such coders. For each pixel block in a frame to be coded, an encoder may transform reference picture data within a search window about a location of the input pixel block based on displacement respectively between the location of the input pixel block and portions of the reference picture within the search window. The encoder may perform a prediction search among the transformed reference picture data to identify a match between the input pixel block and a portion of the transformed reference picture and, when a match is identified, the encoder may code the input pixel block differentially with respect to the matching portion of the transformed reference picture. The transform may counter-act distortions imposed on image content of the reference picture data by the multi-directional format, which aligns the content with image content of the input picture. The techniques apply both for intra-coding and inter-coding.

    SPHERE PROJECTED MOTION ESTIMATION/COMPENSATION AND MODE DECISION

    公开(公告)号:WO2018118159A1

    公开(公告)日:2018-06-28

    申请号:PCT/US2017/051542

    申请日:2017-09-14

    Applicant: APPLE INC.

    CPC classification number: H04N19/597 H04N19/105 H04N19/176 H04N19/547

    Abstract: Techniques are disclosed for coding video data predictively based on predictions made from spherical-domain projections of input pictures to be coded and reference pictures that are prediction candidates. Spherical projection of an input picture and the candidate reference pictures may be generated. Thereafter, a search may be conducted for a match between the spherical-domain representation of a pixel block to be coded and a spherical-domain representation of the reference picture. On a match, an offset may be determined between the spherical-domain representation of the pixel block to a matching portion of the of the reference picture in the spherical-domain representation. The spherical-domain offset may be transformed to a motion vector in a source-domain representation of the input picture, and the pixel block may be coded predictively with reference to a source-domain representation of the matching portion of the reference picture.

    MULTIWAY AUDIO-VIDEO CONFERENCING
    4.
    发明申请

    公开(公告)号:WO2019236167A1

    公开(公告)日:2019-12-12

    申请号:PCT/US2019/023224

    申请日:2019-03-20

    Applicant: APPLE INC.

    Abstract: A device implementing a system for audio-video conferencing using multiple stream identifiers includes a processor configured to receive, from a sending device, indication of a first content stream and a first stream identifier, and indication of a second content stream and a second stream identifier associated. The first content stream and the second content stream correspond to different bit rates of streaming content. The processor is configured to receive, from a receiving device, a request to subscribe to the second content stream, the request including the second stream identifier, and receive, from the sending device, an indication that the second stream identifier has been associated with the first content stream. The processor is configured to forward, to the receiving device, the first content stream based on the request to subscribe to the second content stream and on the indication that the second stream identifier has been associated with the first content stream.

    MEDIA FEED PRIORITIZATION FOR MULTI-PARTY CONFERENCING

    公开(公告)号:WO2019217446A3

    公开(公告)日:2019-11-14

    申请号:PCT/US2019/031155

    申请日:2019-05-07

    Applicant: APPLE INC.

    Abstract: Techniques presented herein provide an improved relay user experience and improved management of scarce computing and network resources as the number of relay endpoints increases. A sourcing endpoint device may generate a media feed, such as video and/or audio feed, representing contribution from a conference participant. The sourcing endpoint device may generate a priority value for the media feed, and the priority value may be transmitted to other members of the relay along with the input feed. Priority values of the different relay participants may be used by other devices, for example, intermediate servers or receiving endpoint devices, to manage aspects of the relay. For example, a relay server may prune streams from select endpoint devices based on relative priority values received from those devices. Alternatively, receiving endpoint devices may alter presentation of received feeds based on their associated priority values.

    SCALABILITY OF MULTI-DIRECTIONAL VIDEO STREAMING

    公开(公告)号:WO2020055655A1

    公开(公告)日:2020-03-19

    申请号:PCT/US2019/049678

    申请日:2019-09-05

    Applicant: APPLE INC.

    Abstract: Aspects of the present disclosure provide techniques for reducing latency and improving image quality of a viewport extracted from multi-directional video communications. First streams of coded video data are received from a source. The first streams include coded data for each of a plurality of tiles representing a multi-directional video, where each tile corresponding to a predetermined spatial region of the multi-directional video, and at least one tile of the plurality of tiles in the first streams contains a current viewport location at a receiver. The techniques include decoding the first streams and displaying the tile containing the current viewport location. When the viewport location at the receiver changes to include a new tile of the plurality of tiles, retrieving and decoding first streams for the new tile, displaying the decoded content for the changed viewport location, and transmitting the changed viewport location to the source.

    VIDEO CODING TECHNIQUES FOR MULTI-VIEW VIDEO

    公开(公告)号:WO2018156403A1

    公开(公告)日:2018-08-30

    申请号:PCT/US2018/018246

    申请日:2018-02-14

    Applicant: APPLE INC.

    Abstract: Techniques are disclosed for coding and decoding video captured as cube map images. According to these techniques, padded reference images are generated for use during predicting input data, A reference image is stored in a cube map format, A padded reference image is generated from the reference image in which image data of a first view contained in reference image is replicated and placed adjacent to a second view contained in the cube map image. When coding a pixel block of an input image, a prediction search may be performed between the input pixel block and content of the padded reference image. When the prediction search identifies a match, the pixel block may be coded with respect to matching data from the padded reference image. Presence of replicated data in the padded reference image is expected to increase the likelihood that adequate prediction matches will be identified for input pixel block data, which will increase overall efficiency of the video coding.

    EFFICIENT SAO SIGNALING
    10.
    发明申请
    EFFICIENT SAO SIGNALING 审中-公开
    高效的信号

    公开(公告)号:WO2015184309A1

    公开(公告)日:2015-12-03

    申请号:PCT/US2015/033265

    申请日:2015-05-29

    Applicant: APPLE INC.

    Abstract: Methods and systems provide efficient sample adaptive offset (SAO) signaling by reducing a number of bits consumed for signaling SAO compared with conventional methods. In an embodiment, a single flag is used if a coding unit to a first scanning direction with respect to a given coding unit is off. In an embodiment, further bits may be saved if some neighboring coding units are not present, i.e. the given coding unit is an edge. For example, a flag may be skipped, e.g., not signaled, if the given coding unit does not have a neighbor. In an embodiment, a syntax element, one or more flags may signal whether SAO filtering is performed in a coding unit. Based on the syntax element, a merge flag may be skipped to save bits. In an embodiment, SAO syntax may be signaled at a slice level.

    Abstract translation: 方法和系统通过减少与常规方法相比信号SAO消耗的比特数来提供有效的采样自适应偏移(SAO)信令。 在一个实施例中,如果关于给定编码单元的第一扫描方向的编码单元关闭,则使用单个标志。 在一个实施例中,如果不存在一些相邻的编码单元,即给定的编码单元是边缘,则可以节省进一步的比特。 例如,如果给定的编码单元不具有邻居,则可以跳过标志,例如,不发信号。 在一个实施例中,语法元素,一个或多个标志可以发信号通知是否在编码单元中执行SAO滤波。 基于语法元素,可以跳过合并标志来保存位。 在一个实施例中,可以在切片级别发信号通知SAO语法。

Patent Agency Ranking