公开(公告)号：US08971407B2

公开(公告)日：2015-03-03

申请号：US13945152

申请日：2013-07-18

Applicant: Pexip AS

Inventor： Lars Petter Endresen

IPC: H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04B1/66 ,  H04N5/14 ,  H04N9/64 ,  H04N19/61

CPC classification number: H04N19/00781 ,  G06F17/147 ,  H04N19/109 ,  H04N19/132 ,  H04N19/14 ,  H04N19/176 ,  H04N19/436 ,  H04N19/61 ,  H04N19/625

Abstract: A method to quickly determine whether a macroblock in H.264 or other similar standards should be encoded in skip mode in a SIMD processor environment is provided. The method exploits the fact that the processor provides enough register space to store N=4 4×4 set of 8 bits data. By performing 4 consecutive reads of 16 linear aligned values into 16 SIMD register variables each capable of storing 16 values, the entire data set for operating can be stored within the processors SIMD register variables and can be operated upon, without any memory related latency.

Abstract translation: 提供了一种快速确定H.264或其他类似标准中的宏块是否应在SIMD处理器环境中以跳过模式进行编码的方法。 该方法利用了处理器提供足够的寄存器空间来存储N = 4×4×4的8位数据的事实。 通过对16个SIMD寄存器变量执行4个连续读取16个线性对齐值，每个能够存储16个值，用于操作的整个数据集可以存储在处理器SIMD寄存器变量中，可以在没有任何内存相关延迟的情况下进行操作。

公开(公告)号：US20140354761A1

公开(公告)日：2014-12-04

申请号：US14285136

申请日：2014-05-22

Applicant: Pexip AS

Inventor： Havard GRAFF

IPC: H04N7/15

CPC classification number: H04N7/152 ,  G06F16/7834 ,  H04M3/567 ,  H04N7/147 ,  H04N7/15

Abstract: According to a general embodiment of the present invention, a computer, tablet or smart phone executable application is provided, allowing a user of the application to activate pairing of the device and a video conference session allowing e.g. for streaming of duo video content or other forms of presentations streams of the video conference session from video conference infrastructure like MCUs, conference bridges or servers.

Abstract translation: 根据本发明的一般实施例，提供了计算机，平板电脑或智能电话可执行应用程序，允许应用程序的用户激活设备的配对和视频会议会话。 用于从诸如MCU，会议桥或服务器的视频会议基础设施流式传输视频会议会议的二重视频内容或其他形式的演示流。

公开(公告)号：US20140313281A1

公开(公告)日：2014-10-23

申请号：US14192492

申请日：2014-03-26

Applicant: PEXIP AS

Inventor： Havard Helland Graff ,  Hakon Dahle

IPC: H04N7/15

CPC classification number: H04N7/152 ,  H04L12/1827 ,  H04L12/185 ,  H04L12/1877 ,  H04L65/403 ,  H04L65/605 ,  H04L65/80

Abstract: A method and a device for providing for sharing encoder resources in an MCU without compromising with image quality and bandwidth adaption is provided. The method and device comprises dynamic allocation of encoders in a multi-party video conference of a number of endpoints, wherein the video conference endpoints are adapted to encode and transmit a media stream comprising the steps of creating a new encoder at a request for a new pad, determining whether a maximum number of encoders is reached, if the maximum number of encoders is not reached, then linking the new pad to the new encoder, if the maximum number of encoders is reached, then linking all existing pads to the new encoder, 15 and releasing all unused encoders.

Abstract translation: 提供了一种用于在不牺牲图像质量和带宽适配的情况下在MCU中共享编码器资源的方法和装置。 该方法和设备包括在多个端点的多方视频会议中对编码器进行动态分配，其中视频会议端点适于对媒体流进行编码和发送，包括以下步骤：在请求新的时候创建新的编码器 垫，确定是否达到最大数量的编码器，如果没有达到最大数量的编码器，则将新焊盘链接到新编码器，如果达到最大数量的编码器，则将所有现有焊盘链接到新编码器 ，15并释放所有未使用的编码器。

公开(公告)号：US20140176666A1

公开(公告)日：2014-06-26

申请号：US13945347

申请日：2013-07-18

Applicant: Pexip AS

Inventor： Giles Russell Chamberlin ,  Hani Mustafa Elsayed Abdelkader Hashim ,  Nicolas Jean Michel Cormier ,  John-Mark Bell ,  Eoin Stuart McLeod ,  Benjamin John Hockley

IPC: H04N7/15

CPC classification number: H04N7/152 ,  H04L12/1822 ,  H04M3/563 ,  H04M3/565 ,  H04M3/567 ,  H04M2201/50

Abstract: A method for managing media streams including at least video data and audio data in a multi-party video conference involving one or more groups of one or more nodes respectively receiving a media stream from each of a plurality of associated endpoints is provided. In each of the one or more nodes of each of the one or more groups, the loudest audio of the media streams received from the respective plurality of associated endpoints is determined. An indication of the volume of the determined loudest audio and an identification of the node is transmitted to a decision maker. The highest received volume and the associated identification is determined. The node of the identification is instructed to transmit the received media stream of the endpoint to one of: all nodes in the one or more groups and to a proxy.

Abstract translation: 提供了一种在多方视频会议中管理至少包括视频数据和音频数据的媒体流的方法，所述多方视频会议涉及分别从多个关联端点中的每一个接收媒体流的一个或多个节点的一个或多个组。 在一个或多个组中的每一个的一个或多个节点的每一个中，确定从相应的多个相关联的端点接收的媒体流的最大音频。 将确定的最大音频的音量和节点的标识的指示传送给决策者。 确定最高接收量和相关标识。 指示识别的节点将接收到的端点的媒体流发送到一个或多个组中的所有节点之一，并发送到代理。

公开(公告)号：EP4184885A1

公开(公告)日：2023-05-24

申请号：EP22207369.4

申请日：2022-11-15

Applicant: Pexip AS

Inventor： GRAFF, Håvard ,  BELOQUI, Tulio ,  HVIDSTEN, Knut Inge

IPC: H04L47/19 ,  H04L47/263 ,  H04L47/27 ,  H04L47/35 ,  H04L47/36 ,  H04L47/11 ,  H04L47/127 ,  H04L47/193 ,  H04L47/283

Abstract: System and method for determining congestion of a communication link transmitting a media stream over the communication link from a sender device to a receiving device. The method comprising transmitting media packets into the media stream, each media packet having a packet identifier; transmitting recovery packets into the media stream, each recovery packet having a packet identifier and is adapted to replace a missing packet of the media stream; mapping for each packet in the media stream the packet identifier, a transmission timestamp and a packet size; - mapping for each recovery packet the packet identifier of the recovery packet and the packet identifier of the packet the recovery packet is adapted to replace; transmitting for each packet received at the receiving device a feedback message to the sender device, the feedback message comprising the packet identifier and an arrival timestamp; determining a packet as missing when none of the feedback messages comprises the packet identifier of the packet; determining a packet as recovered when a feedback message comprises the packet identifier of a recovery packet corresponding to the missing packet; and determining a packet recovery success rate by dividing a total number of packets determined as recovered within a first sliding window with a total number of packets determined as missing within the first sliding window; and determining that the communication link is congested when for the first sliding window of the N transmitted packets the packet recovery success rate is below a congestion threshold.

公开(公告)号：EP3926584A1

公开(公告)日：2021-12-22

申请号：EP21177482.3

申请日：2021-06-02

Applicant: Pexip AS

Inventor： GRAFF, Håvard

IPC: G06T7/262 ,  H04N7/15 ,  G06T7/215 ,  H04N19/85 ,  G06T7/155 ,  G06T7/194

Abstract: The present invention relates to an image processing device and a method of framing changes and movements in a video image divided into NxN blocks of pixel positions. The method comprises calculating a first bitmap of the video image by a DCT transform on each of the NxN blocks of pixel positions, assigning a first binary value to the pixel positions of the NxN blocks when more than an amount of change, and a second binary value to the pixel positions of the NxN blocks when less than an amount of change. Calculating a third bitmap by an OR operation between a number of bitmaps representing past time frames of the video image, calculating a fourth bitmap by performing a dilation process of the third bitmap representing the current time frame of the video image, and creating one or more frames identifying area of changes and movements in the video image based on detecting BLOBs (Binary Large Objects) in the fourth bitmaps.

公开(公告)号：EP4016926A1

公开(公告)日：2022-06-22

申请号：EP21214339.0

申请日：2021-12-14

Applicant: Pexip AS

Inventor： Graff, Håvard ,  Beloqui, Tulio

IPC: H04L12/18

Abstract: A real time audio multi-point videoconferencing system comprising at least two videoconferencing endpoints in communication with a multipoint control unit, and a method of providing the real time audio. The method comprising capturing input lossless digital audio streams on each of the at least two videoconferencing endpoints, transmitting the input lossless digital audio streams from each of the at least two videoconferencing endpoints to the MCU using a frame size in the range 0.25 ms - 3 ms, mixing, using the MCU, the input lossless digital audio streams into a plurality of output lossless digital audio streams, transmitting a different one of the plurality of output lossless digital audio streams to each of the at least two videoconferencing endpoints using a frame size in the range 0.25 ms - 3 ms, and playback the plurality of output lossless digital audio streams on each of the at least two videoconferencing endpoints.

公开(公告)号：EP2987273B1

公开(公告)日：2018-11-21

申请号：EP14723005.6

申请日：2014-04-15

Applicant: Pexip AS

Inventor： GRAFF, Håvard

IPC: H04L12/18

CPC classification number: H04N7/152 ,  H04L12/1827 ,  H04L12/185 ,  H04L12/1877 ,  H04L65/403 ,  H04L65/605 ,  H04L65/80

Abstract: A method and a device for providing for sharing encoder resources in an MCU without compromising with image quality and bandwidth adaption is provided. The method and device comprises dynamic allocation of encoders in a multi-party video conference of a number of endpoints, wherein the video conference endpoints are adapted to encode and transmit a media stream comprising the steps of creating a new encoder at a request for a new pad, determining whether a maximum number of encoders is reached, if the maximum number of encoders is not reached, then linking the new pad to the new encoder, if the maximum number of encoders is reached, then linking all existing pads to the new encoder, 15 and releasing all unused encoders.

公开(公告)号：EP4113516A1

公开(公告)日：2023-01-04

申请号：EP22176918.5

申请日：2022-06-02

Applicant: Pexip AS

Inventor： KIM, Anna ,  SHAW, Eamonn

IPC: G10L21/0232 ,  G10L25/84

Abstract: A method of speech detection and speech enhancement in a speech detection and speech enhancement unit of Multipoint Conferencing Node (MCN) and a method of training the same. The method comprising receiving input audio segments, and determining an acoustic environment based on input audio auxiliary information, extracting T-F-domain features from the received input audio segments, determining if each of the received input audio segments is speech by inputting the T-F domain features into a speech detection classifier trained for the determined acoustic environment, determining, when one of the received input audio segments is speech, if the received audio segment is noisy speech by inputting the T-F domain features into a noise classifier using a statistical generative model representing the probability distributions of the T-F domain features of noisy speech trained for the determined acoustic environment, and applying a noise reduction mask on the received input audio segments according to the determination of the received audio segment is noisy speech

公开(公告)号：EP3255883A1

公开(公告)日：2017-12-13

申请号：EP17174918.7

申请日：2017-06-08

Applicant: Pexip AS

Inventor： SHAW, Eamonn ,  CORMIER, Nicolas

IPC: H04N7/14

CPC classification number: H04N7/152 ,  H04L12/1831 ,  H04L65/403 ,  H04L67/02 ,  H04N7/155

Abstract: Timeline (200) information is provided to endpoints in a video conferencing system. The timeline (200) comprises a starting time point (201), a current time point (203) and a plurality of timestamps (202) that represent respective points in time between the starting time point and the current time point. A plurality of events are detected that are associated with respective system generated activities or activities performed by participants located at the endpoints. Event information is provided, to at least one endpoint, for displaying along the timeline a respective graphical item (204) representing respective detected events. This provision of event information is performed repeatedly such that the graphical items slide along the timeline in a direction away from the current time point.

Abstract translation: 时间线（200）信息被提供给视频会议系统中的端点。 时间线（200）包括表示开始时间点和当前时间点之间的各个时间点的开始时间点（201），当前时间点（203）和多个时间戳（202）。 检测与由位于端点处的参与者执行的各个系统生成的活动或活动相关联的多个事件。 向至少一个端点提供事件信息，用于沿着时间线显示表示各自检测到的事件的相应图形项目（204）。 事件信息的这种提供被重复执行，使得图形项目沿着时间线在远离当前时间点的方向上滑动。