公开(公告)号：US20230397270A1

公开(公告)日：2023-12-07

申请号：US18328582

申请日：2023-06-02

Applicant: Apple Inc.

Inventor： Christopher M. Garrido ,  Bradley D. Ford ,  Gurtej Singh G. Chandok ,  Justin R. Etzine ,  Karthick Santhanam ,  Luciano M. Verger ,  Padmavathy Bhooma

IPC: H04W76/14 ,  H04N23/63 ,  G06F3/0346 ,  H04N23/661 ,  H04W8/00

CPC classification number: H04W76/14 ,  H04N23/63 ,  G06F3/0346 ,  H04N23/661 ,  H04W8/005

Abstract: Devices, methods, and non-transitory program storage devices are disclosed to enable the automatic establishment of a secure audio/video data streaming connection between electronic devices. For example, a first electronic device may enter into a first state of a peer device advertising protocol, and then, based on a determination that the first electronic device meets a first set of device state criteria (e.g., including at least an orientation state criterion), the first electronic device may enter into a second (e.g., enhanced) state of the peer device advertising protocol. In response to detecting a presence of a second electronic device in its proximity, the first electronic device may connect to the second electronic device via a secure peer-to-peer connection protocol and then send one or more images captured by a first image capture device of the first electronic device to the connected second electronic device via the secure wireless peer-to-peer connection protocol.

公开(公告)号：US20230396835A1

公开(公告)日：2023-12-07

申请号：US18297804

申请日：2023-04-10

Applicant: Apple Inc.

Inventor： Erik Vladimir Ortega Gonzales ,  Maxwell J. Hawkins ,  Ming Jin ,  Chieh Lu ,  Ahmad M. Kholaif ,  Ashwin Ramesh ,  Christopher M. Garrido ,  Hsien-Po Shiang ,  Karthick Santhanam ,  Luciano M. Verger ,  Jose A. Lozano Hinojosa ,  David L. Biderman

IPC: H04N21/44 ,  H04L49/9047 ,  H04L1/08 ,  H04L47/34 ,  H04L65/75 ,  H04N21/437 ,  H04N21/231 ,  H04N21/24

CPC classification number: H04N21/44004 ,  H04L49/9047 ,  H04L1/08 ,  H04L47/34 ,  H04L65/75 ,  H04N21/437 ,  H04N21/23106 ,  H04N21/2407

Abstract: A method and apparatus of a device that manages a video stream is described. In an exemplary embodiment, the device receives a plurality of packets for a video stream from a transmitting device via a server. The device may additionally store a first packet of the plurality of packets in a first buffer when the first packet is on-time and store a second packet of the plurality of packets in a second buffer when the second packet is late. The device may also further forward a frame from the second buffer to the first buffer when frame is complete.

公开(公告)号：US11184415B2

公开(公告)日：2021-11-23

申请号：US16405864

申请日：2019-05-07

Applicant: Apple Inc.

Inventor： Christopher M. Garrido ,  Dazhong Zhang ,  Karthick Santhanam ,  Patrick Miauton ,  Xiaoxiao Zheng ,  Bess Chan ,  Peter Shiang ,  Sudeng Hu ,  Peikang Song ,  Xiaosong Zhou

IPC: H04L29/06 ,  H04L29/08 ,  H04N21/235 ,  H04N21/6583

Abstract: Techniques presented herein provide an improved relay user experience and improved management of scarce computing and network resources as the number of relay endpoints increases. A sourcing endpoint device may generate a media feed, such as video and/or audio feed, representing contribution from a conference participant. The sourcing endpoint device may generate a priority value for the media feed, and the priority value may be transmitted to other members of the relay along with the input feed. Priority values of the different relay participants may be used by other devices, for example, intermediate servers or receiving endpoint devices, to manage aspects of the relay. For example, a relay server may prune streams from select endpoint devices based on relative priority values received from those devices. Alternatively, receiving endpoint devices may alter presentation of received feeds based on their associated priority values.

公开(公告)号：US11509423B2

公开(公告)日：2022-11-22

申请号：US16996799

申请日：2020-08-18

Applicant: Apple Inc.

Inventor： Daniel B. Pollack ,  Karthick Santhanam ,  Qian Sun ,  Kevin Arthur Robertson ,  Hsien-Po Shiang ,  Erik Vladimir Ortega Gonzalez ,  Christopher M. Garrido ,  Bradley F. Patterson

IPC: H04L1/08 ,  H04L69/04 ,  H04L49/90

Abstract: A device implementing dynamic redundancy may include at least one processor configured to receive, from another device, packet reception data corresponding to video data previously provided for transmission from the device to the other device and determine, based at least in part on the packet reception data, an amount of redundancy to apply to video data provided for transmission to the other device. The at least one processor may be further configured to determine, based at least in part on the amount of redundancy, an encoding scheme for applying the redundancy to the video data. The at least one processor may be further configured to apply the amount of redundancy to the video data based at least in part on the encoding scheme to generate redundant data items and provide the video data and the redundant data items for transmission to the other device.

公开(公告)号：US20210398563A1

公开(公告)日：2021-12-23

申请号：US17349733

申请日：2021-06-16

Applicant: Apple Inc.

Inventor： Gurtej Singh G. Chandok ,  Eric L. Chien ,  Christopher M. Garrido ,  Ming Jin ,  Karthick Santhanam ,  Brian T. Toombs ,  Joshua L. Hare ,  David L. Biderman ,  Patrick Miauton ,  Luciano M. Verger

IPC: G11B27/00

Abstract: A video playback buffer adjustment system is disclosed. The video playback buffer has a target size, measured in units of time of content, and includes a compressed frames queue and an uncompressed frames queue. The uncompressed frames queue has a minimum threshold queue size. If the size of the uncompressed frames queue falls below the minimum threshold size, then a next encoded frame in the compressed frames queue is removed from the compressed frames queue, decoded, and enqueued in the uncompressed frames queue. If a current size of the playback queue exceeds the target size plus Δ (a hysteresis value), then a playback frame rate is increased, and a presentation time of one or more frames in the uncompressed frames queue is adjusted according to the increased playback frame rate. If the playback queue size is less than the target size minus Δ, the playback speed can be reduced.

公开(公告)号：US11109042B2

公开(公告)日：2021-08-31

申请号：US16420740

申请日：2019-05-23

Applicant: Apple Inc.

Inventor： Sudeng Hu ,  Xing Wen ,  Jae Hoon Kim ,  Peikang Song ,  Hang Yuan ,  Dazhong Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Christopher Garrido ,  Ming Jin ,  Patrick Miauton ,  Karthick Santhanam

IPC: H04N19/172 ,  H04N19/182 ,  H04N19/124 ,  H04N19/176 ,  H04N19/52 ,  H04N19/159

Abstract: Systems and methods for coding a video to be overlaid by annotations are devised. A motion compensated predictive coding is employed, wherein coding parameters of video pixel blocks are determined based on the pixel blocks' relation to the annotations. A decoder decodes the video and annotates it based on metadata, obtained from the coder or other sources, describing the annotations' appearance and rendering mode.

公开(公告)号：US12177643B1

公开(公告)日：2024-12-24

申请号：US18503816

申请日：2023-11-07

Applicant: Apple Inc.

Inventor： Sean A. Ramprashad ,  Peter D. Callaway ,  Jae Woo Chang ,  Martin E. Johnson ,  Daniel K. Boothe ,  Kostyantyn Komarov ,  Patrick Miauton ,  Christopher M. Garrido ,  Austin W. Shyu ,  Karthick Santhanam

IPC: H04S3/00 ,  G06F3/0487 ,  H04R3/00 ,  H04S5/00 ,  H04S7/00

Abstract: A method performed a local device that is communicatively coupled with several remote devices, the method includes: receiving, from each remote device with which the local device is engaged in a communication session, an input audio stream; receiving, for each remote device, a set parameters; determining, for each input audio stream, whether the input audio stream is to be 1) rendered individually or 2) rendered as a mix of input audio streams based on the set of parameters; for each input audio stream that is determined to be rendered individually, spatially rendering the input audio stream as an individual virtual sound source that contains only that input audio stream; and for input audio streams that are determined to be rendered as the mix of input audio streams, spatially rendering the mix of input audio streams as a single virtual sound source that contains the mix of input audio streams.

公开(公告)号：US11949529B2

公开(公告)日：2024-04-02

申请号：US17956764

申请日：2022-09-29

Applicant: Apple Inc.

Inventor： Karthick Santhanam ,  Eric L. Chien ,  Christopher M. Garrido ,  Kyle W. Horn ,  Ian J. Baird ,  Qian Sun ,  David L. Biderman

IPC: H04L12/18 ,  H04N5/232 ,  H04N23/951

CPC classification number: H04L12/1822 ,  H04N23/951

Abstract: The subject technology receives, at a local device, a requested camera format based on specifications of a display associated with a remote device. The remote device and the local device are devices participating in a video conference. The requested camera format includes a first resolution. Camera formats supported by a camera associated with the local device are determined. If a second resolution of a first camera format matches among the supported camera formats matches with the first resolution, the first camera format is selected for capturing the video stream by the camera. Otherwise, a second camera format among the supported camera formats is determined for capturing the video stream so as to maximize a field of view of the video stream relative to other camera formats supported by the camera.

公开(公告)号：US11791939B2

公开(公告)日：2023-10-17

申请号：US17973498

申请日：2022-10-25

Applicant: Apple Inc.

Inventor： Daniel B. Pollack ,  Karthick Santhanam ,  Qian Sun ,  Kevin Arthur Robertson ,  Hsien-Po Shiang ,  Erik Vladimir Ortega Gonzalez ,  Christopher M. Garrido ,  Bradley F. Patterson

IPC: H04L1/08 ,  H04L49/90 ,  H04L69/04

CPC classification number: H04L1/08 ,  H04L49/90 ,  H04L69/04

Abstract: A device implementing dynamic redundancy may include at least one processor configured to receive, from another device, packet reception data corresponding to video data previously provided for transmission from the device to the other device and determine, based at least in part on the packet reception data, an amount of redundancy to apply to video data provided for transmission to the other device. The at least one processor may be further configured to determine, based at least in part on the amount of redundancy, an encoding scheme for applying the redundancy to the video data. The at least one processor may be further configured to apply the amount of redundancy to the video data based at least in part on the encoding scheme to generate redundant data items and provide the video data and the redundant data items for transmission to the other device.

公开(公告)号：US11677934B2

公开(公告)日：2023-06-13

申请号：US17485298

申请日：2021-09-24

Applicant: Apple Inc.

Inventor： Sudeng Hu ,  David L. Biderman ,  Christopher M. Garrido ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Dazhong Zhang ,  Jinbo Qiu ,  Karthick Santhanam ,  Hang Yuan ,  Joshua L. Hare ,  Luciano M. Verger ,  Kevin Arthur Robertson ,  Sasanka Vemuri

IPC: H04N7/12 ,  H04N19/105 ,  H04N19/177 ,  H04N19/172 ,  H04N19/146 ,  H04N19/124

CPC classification number: H04N19/105 ,  H04N19/124 ,  H04N19/146 ,  H04N19/172 ,  H04N19/177

Abstract: In an example method, a system receives a plurality of frames of a video, and generates a data structure representing the video and representing a plurality of temporal layers. Generating the data structure includes: (i) determining a plurality of quality levels for presenting the video, where each of the quality levels corresponds to a different respective sampling period for sampling the frames of the video, (ii) assigning, based on the sampling periods, each of the frames to a respective one of the temporal layers of the data structure, and (iii) indicating, in the data structure, one or more relationships between (a) at least one the frames assigned to at least one of the temporal layers of the data structure, and (b) at least another one of the frames assigned to at least another one of the temporal layers of the data structure. Further, the system outputs the data structure.