-
公开(公告)号:US11677934B2
公开(公告)日:2023-06-13
申请号:US17485298
申请日:2021-09-24
Applicant: Apple Inc.
Inventor: Sudeng Hu , David L. Biderman , Christopher M. Garrido , Hsi-Jung Wu , Xiaosong Zhou , Dazhong Zhang , Jinbo Qiu , Karthick Santhanam , Hang Yuan , Joshua L. Hare , Luciano M. Verger , Kevin Arthur Robertson , Sasanka Vemuri
IPC: H04N7/12 , H04N19/105 , H04N19/177 , H04N19/172 , H04N19/146 , H04N19/124
CPC classification number: H04N19/105 , H04N19/124 , H04N19/146 , H04N19/172 , H04N19/177
Abstract: In an example method, a system receives a plurality of frames of a video, and generates a data structure representing the video and representing a plurality of temporal layers. Generating the data structure includes: (i) determining a plurality of quality levels for presenting the video, where each of the quality levels corresponds to a different respective sampling period for sampling the frames of the video, (ii) assigning, based on the sampling periods, each of the frames to a respective one of the temporal layers of the data structure, and (iii) indicating, in the data structure, one or more relationships between (a) at least one the frames assigned to at least one of the temporal layers of the data structure, and (b) at least another one of the frames assigned to at least another one of the temporal layers of the data structure. Further, the system outputs the data structure.
-
公开(公告)号:US11637886B2
公开(公告)日:2023-04-25
申请号:US17168107
申请日:2021-02-04
Applicant: Apple Inc.
Inventor: Daniel B. Pollack , Karthick Santhanam , Christopher M. Garrido , Jingyao Zhang , Ming Jin , Hyeonkuk Jeong
IPC: H04L65/80 , H04N21/24 , H04W16/14 , H04L65/70 , H04L65/612
Abstract: A device implementing cellular communication protocol aware multimedia streaming may include at least one processor configured to establish a link for communicating with another device, wherein the link utilizes at least one of a first cellular communication protocol or a second cellular communication protocol. The at least one processor may be configured to determine a bit rate for a video stream to be provided to the other device based at least in part on whether the link utilizes the first cellular communication protocol or the second cellular communication protocol, wherein a first bit rate is determined when the link utilizes the first cellular communication protocol and a second bit rate is determined when the link utilizes the second cellular communication protocol. The at least one processor may be configured to provide, for transmission over the link to the other electronic device, the video stream at the determined bit rate.
-
公开(公告)号:US20230098082A1
公开(公告)日:2023-03-30
申请号:US17485298
申请日:2021-09-24
Applicant: Apple Inc.
Inventor: Sudeng Hu , David L. Biderman , Christopher M. Garrido , Hsi-Jung Wu , Xiaosong Zhou , Dazhong Zhang , Jinbo Qiu , Karthick Santhanam , Hang Yuan , Joshua L. Hare , Luciano M. Verger , Kevin Arthur Robertson , Sasanka Vemuri
IPC: H04N19/105 , H04N19/177 , H04N19/124 , H04N19/146 , H04N19/172
Abstract: In an example method, a system receives a plurality of frames of a video, and generates a data structure representing the video and representing a plurality of temporal layers. Generating the data structure includes: (i) determining a plurality of quality levels for presenting the video, where each of the quality levels corresponds to a different respective sampling period for sampling the frames of the video, (ii) assigning, based on the sampling periods, each of the frames to a respective one of the temporal layers of the data structure, and (iii) indicating, in the data structure, one or more relationships between (a) at least one the frames assigned to at least one of the temporal layers of the data structure, and (b) at least another one of the frames assigned to at least another one of the temporal layers of the data structure. Further, the system outputs the data structure.
-
公开(公告)号:US11606574B2
公开(公告)日:2023-03-14
申请号:US16882819
申请日:2020-05-26
Applicant: Apple Inc.
Inventor: Dazhong Zhang , Peikang Song , Beibei Wang , Giribalan Gopalan , Albert E. Keinath , Christopher M. Garrido , David R. Conrad , Hsi-Jung Wu , Ming Jin , Hang Yuan , Xiaohua Yang , Xiaosong Zhou , Vikrant Kasarabada , Davide Concion , Eric L. Chien , Bess C. Chan , Karthick Santhanam , Gurtej Singh Chandok
IPC: H04N19/507 , H04N19/65
Abstract: Techniques are disclosed for coding video data in which frames from a video source are partitioned into a plurality of tiles of common size, and the tiles are coded as a virtual video sequence according to motion-compensated prediction, each tile treated as having respective temporal location of the virtual video sequence. The coding scheme permits relative allocation of coding resources to tiles that are likely to have greater significance in a video coding session, which may lead to certain tiles that have low complexity or low motion content to be skipped during coding of the tiles for select source frames. Moreover, coding of the tiles may be ordered to achieve low coding latencies during a coding session.
-
公开(公告)号:US20210400338A1
公开(公告)日:2021-12-23
申请号:US17304273
申请日:2021-06-17
Applicant: Apple Inc.
Inventor: Luciano M. Verger , David L. Biderman , Christopher M. Garrido , Karthick Santhanam , Brian T. Toombs , Gurtej Singh G. Chandok , Joshua L. Hare , Patrick Miauton , Ming Jin , Bradley F. Patterson
IPC: H04N21/44 , H04N21/442 , H04N21/458
Abstract: A method and apparatus of a device that uses a video jitter buffer to buffer the video frames for a received video stream is described. The device uses the video jitter buffer to estimate the delay variability of the frames and pick a target delay that will help harmonize the playback with minimal loss and delay. This is achieved by estimating the delay spread, which is the result of performing statistical analysis of the measured lags of the video frames received. The video jitter buffer provides target delay recommendation and reference frame information to the video player in order to anchor the playback and schedule the frames presentation time.
-
26.
公开(公告)号:US20210399971A1
公开(公告)日:2021-12-23
申请号:US17304312
申请日:2021-06-17
Applicant: Apple Inc.
Inventor: Hsien-Po Shiang , Ming Jin , Gabriel Nava Marino , Gurtej Singh G. Chandok , Hyeonkuk Jeong , Padmavathy Bhooma , Christoph Paasch , Christopher M. Garrido , David L. Biderman , Erik Vladimir Ortega Gonzalez
Abstract: The embodiments described herein can dynamically adjust timing of network bandwidth estimations by adjusting a target frequency for sending probing sequences to one or more receivers of content. The receivers receive these probing sequences from a transmitter and respond to the transmitter with network bandwidth estimations. In one embodiment, the probing sequences can use the content itself to create the probing sequences. The embodiments can be used in video conferencing applications to control how a transmitter of content can adjust transmissions based upon the network bandwidth estimations. In one embodiment, a policy can be used at a transmitter to begin a video transmission with a high frequency target for sending probing sequences (with, e.g., smaller length probing sequences) and transition to a lower frequency target (with, e.g., longer length probing sequences) when network bandwidth deteriorates and then return to the higher frequency target when the network bandwidth improves.
-
公开(公告)号:US11165989B2
公开(公告)日:2021-11-02
申请号:US16689458
申请日:2019-11-20
Applicant: Apple Inc.
Inventor: Johnny Trenh , Hsi-Jung Wu , Sarah K. Herrlinger , Xiaoxia Sun , Ian J. Baird , Dazhong Zhang , Xiaosong Zhou , Christopher M. Garrido
Abstract: Techniques are presented for managing for visual prominence of participants in a video conference, including conferences where participants communicate visually, such as with sign language. According to these techniques, a visual prominence indication of a participant in a video conference may be estimated, a video stream of the participant may be encoded, and the encoded video stream may be transmitted along with an indication of the estimated visual prominence to a receiving device in the video conference.
-
公开(公告)号:US10911992B2
公开(公告)日:2021-02-02
申请号:US16145055
申请日:2018-09-27
Applicant: Apple Inc.
Inventor: Joe S. Abuan , Ian J. Baird , Xiaosong Zhou , Christopher M. Garrido , Dazhong Zhang , Keith W. Rauenbuehler , Yan Yang , Patrick Miauton , Eric L. Chien , Berkat S. Tung , Karthick Santhanam
IPC: H04W72/12 , H04W36/00 , H04L29/08 , H04W4/08 , H04L29/06 , H04W12/04 , H04W12/06 , G06F9/48 , H04W36/02 , H04L12/18 , H04L9/08 , H04B17/318 , H04B17/336
Abstract: A device implementing the subject technology may include at least one processor configured to receive a plurality of buffer reports from a plurality of other devices, each of the plurality of buffer reports indicating a current target buffer level for a respective one of the plurality of other devices. The at least one processor may be further configured to determine a group target buffer level based at least in part on the current target buffer levels of the plurality of other devices and a current target buffer level of the at least one buffer. The at least one processor may be further configured to transmit the group target buffer level to the plurality of other devices. The at least one processor may be further configured to manage an occupancy of the at least one buffer based at least in part on the group target buffer level.
-
公开(公告)号:US10523820B2
公开(公告)日:2019-12-31
申请号:US15991905
申请日:2018-05-29
Applicant: Apple Inc.
Inventor: Christopher M. Garrido , Eric L. Chien , Wenhui Xu , Xiaoxiao Zheng , Spencer E. Lewson , Keith W. Rauenbuehler , Komei Harada , Ming Jin , Gurtej Singh G. Chandok , David L. Biderman
Abstract: A first request to form a conference call is received from a first of a plurality of electronic devices. In response to the first request, a conference data structure is generated in a memory. Based on determining the conference call has ended, a second request is transmitted to each of the plurality of electronic devices to return a high-resolution video stream generated by each electronic device during the conference call. In response to the second requests, the high-resolution video stream is received from at least some of the plurality of electronic devices. Each of the received high-resolution video streams is stored in the conference data structure in the memory to generate a completed conference data structure. A notice that the completed conference data structure is available is transmitted to each of the plurality of electronic devices.
-
公开(公告)号:US20190342240A1
公开(公告)日:2019-11-07
申请号:US16151239
申请日:2018-10-03
Applicant: Apple Inc.
Inventor: Christopher M. Garrido , Eric L. Chien , Austin W. Shyu , Ming Jin , Yan Yang , Ian J. Baird , Joe S. Abuan
IPC: H04L12/58 , H04M1/725 , G06F3/0484 , G06K9/00
Abstract: The subject technology provides a messaging application in which an image can be captured and supplemented with supplemental content such as stickers, animations, etc., from within an active messaging thread. In this manner, a user participating in a messaging conversation with a remote user can add stickers, animations, and/or adaptive content to an image captured by the user, without having to locally cache/store the captured image before editing and without having to leave the messaging conversion (or the messaging application) to access an image editing application.
-
-
-
-
-
-
-
-
-