公开(公告)号：US11653026B2

公开(公告)日：2023-05-16

申请号：US17252700

申请日：2019-06-27

Applicant: Apple Inc.

Inventor： Jim C. Chou ,  Sorin C. Cismas

IPC: H04N19/117 ,  H04N19/147 ,  H04N19/63 ,  H04N19/174 ,  H04N19/176 ,  H04N19/18

CPC classification number: H04N19/63 ,  H04N19/117 ,  H04N19/147 ,  H04N19/174 ,  H04N19/176 ,  H04N19/18

Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder. The encoded frequency data is packetized and transmitted to a receiving device. On the receiving device, the encoded data is decoded to recover the frequency bands. Wavelet synthesis is then performed on the frequency bands to reconstruct the pixel data for display. The system may encode parts of frames (tiles or slices) using one or more encoders and transmit the encoded parts as they are ready. A pre-filter component may perform a lens warp on the pixel data prior to the wavelet transform.

公开(公告)号：US20230080223A1

公开(公告)日：2023-03-16

申请号：US17589589

申请日：2022-01-31

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Ganesh G. Yadav

IPC: H04N19/66 ,  H04N19/174 ,  H04N19/186 ,  H04L65/65 ,  H04L65/60

Abstract: This disclosure is directed to systems and methods of data partitioning in image encoding. A video encoder may receive a single stream of video data that includes multiple layers. The video encoder may encode the one or more layers utilizing multiple counters for each component within the layers. The multiple counters may correspond to the header bits, luma bits, and chroma bits within each slice layer. The encoded layers may then be assembled into a single slice before it is sent to a decoder for decoding of image frame.

公开(公告)号：US20230079859A1

公开(公告)日：2023-03-16

申请号：US17589641

申请日：2022-01-31

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Ganesh G. Yadav

IPC: H04N19/70 ,  H04N19/184 ,  H04N19/186 ,  H04N19/174

Abstract: This disclosure is directed to systems and methods of streaming extensions for video encoding. The streaming extensions may enable the bitstream syntax for layered video data to be modified to reduce overhead for encoding. The bitstream syntax may be modified to enable variable length luma and chroma components, and enable the alignment between the layers and slice to be bit aligned to enable increased granularity in image encoding, and to minimize overhead between different elements within the layers.

公开(公告)号：US10264264B2

公开(公告)日：2019-04-16

申请号：US15275373

申请日：2016-09-24

Applicant: Apple Inc.

Inventor： Abheek Banerjee ,  Syed Muhammad A. Rizvi ,  Yaxiong Zhou ,  Sorin C. Cismas

IPC: H04N19/44 ,  H04N19/42 ,  H04N19/13 ,  H04N19/21 ,  H04N19/436 ,  H04N19/70 ,  H04N19/91

Abstract: Systems and methods for improving decoding of encoded image data using parallel multi-bin decoding are provided. In one embodiment, multiple context bins per cycle are decoded for a set of syntax elements, by decoupling and/or retiming particular syntax parsing and/or arithmetic decoding tasks of the decoding process.

公开(公告)号：US20240314361A1

公开(公告)日：2024-09-19

申请号：US18671720

申请日：2024-05-22

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Ganesh G. Yadav

IPC: H04N19/66 ,  H04L65/65 ,  H04L65/70 ,  H04N19/174 ,  H04N19/186

CPC classification number: H04N19/66 ,  H04L65/65 ,  H04L65/70 ,  H04N19/174 ,  H04N19/186

Abstract: This disclosure is directed to systems and methods of data partitioning in image encoding. A video encoder may receive a single stream of video data that includes multiple layers. The video encoder may encode the one or more layers utilizing multiple counters for each component within the layers. The multiple counters may correspond to the header bits, luma bits, and chroma bits within each slice layer. The encoded layers may then be assembled into a single slice before it is sent to a decoder for decoding of image frame.

公开(公告)号：US20240121401A1

公开(公告)日：2024-04-11

申请号：US18545989

申请日：2023-12-19

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Ganesh G. Yadav

IPC: H04N19/149 ,  H04N19/14 ,  H04N19/174 ,  H04N19/186 ,  H04N19/30

CPC classification number: H04N19/149 ,  H04N19/14 ,  H04N19/174 ,  H04N19/186 ,  H04N19/30

Abstract: This disclosure is directed to systems and methods of rate control in multiple pass video encoding. The video encoder may complete multiple encoding passes for slices of an image. Rate control algorithms may be implemented that scale the quantization step size and quantization matrix values depending on the determined size of the image slices. This may enable the size of slices to be adjusted based on size parameters for the image data.

公开(公告)号：US11695977B2

公开(公告)日：2023-07-04

申请号：US16586452

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Moinul H. Khan ,  Jim C. Chou ,  Sorin C. Cismas

IPC: H04N21/2662 ,  H04N19/59 ,  H04W72/08 ,  H04L1/00

CPC classification number: H04N21/2662 ,  H04L1/0003 ,  H04L1/0009 ,  H04N19/59 ,  H04W72/085

Abstract: An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.

公开(公告)号：US20210250616A1

公开(公告)日：2021-08-12

申请号：US17252700

申请日：2019-06-27

Applicant: Apple Inc.

Inventor： Jim C. Chou ,  Sorin C. Cismas

IPC: H04N19/63 ,  H04N19/176 ,  H04N19/117 ,  H04N19/147 ,  H04N19/174 ,  H04N19/18

Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder. The encoded frequency data is packetized and transmitted to a receiving device. On the receiving device, the encoded data is decoded to recover the frequency bands. Wavelet synthesis is then performed on the frequency bands to reconstruct the pixel data for display. The system may encode parts of frames (tiles or slices) using one or more encoders and transmit the encoded parts as they are ready. A pre-filter component may perform a lens warp on the pixel data prior to the wavelet transform.

公开(公告)号：US11064387B1

公开(公告)日：2021-07-13

申请号：US16411302

申请日：2019-05-14

Applicant: Apple Inc.

Inventor： Aleksandr M. Movshovich ,  Arthur Y. Zhang ,  Hao Pan ,  Holly E. Gerhard ,  Jim C. Chou ,  Moinul H. Khan ,  Paul V. Johnson ,  Sorin C. Cismas ,  Sreeraman Anantharaman ,  William W. Sprague

IPC: H04W28/06 ,  H04W24/08 ,  H04N13/398 ,  H04N13/344 ,  H04N13/194

Abstract: One exemplary implementation involves performing operations at an electronic device with one or more processors and a computer-readable storage medium. The device establishes a wireless communication link with a host device. The device receives, from the host device, a left eye frame and a right eye frame via a sequence of left eye frame transmissions and right eye frame transmissions. The device switches data transmissions schemes according to wireless commination link quality or eye gaze tracking. Adjusting transmission format based on transmission quality of the wireless communication link allows the devices to take advantage of greater bandwidth when available to save power. An additional transmission format is based on alternately transmitting left eye and right eye frames for very low bandwidth.

公开(公告)号：US20250142150A1

公开(公告)日：2025-05-01

申请号：US18964961

申请日：2024-12-02

Applicant: Apple Inc.

Inventor： Moinul H. Khan ,  Jim C. Chou ,  Sorin C. Cismas

IPC: H04N21/2662 ,  H04L1/00 ,  H04N19/59 ,  H04W72/542

Abstract: An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.