公开(公告)号：US11110349B2

公开(公告)日：2021-09-07

申请号：US16696125

申请日：2019-11-26

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Kelvin M. Yong

IPC: A63F13/355 ,  H04L29/08 ,  H04L29/06 ,  A63F13/358 ,  A63F13/44 ,  H04N21/242 ,  H04N21/43 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/8547 ,  A63F13/335 ,  G07F17/32 ,  H04N21/2343 ,  H04N21/478

Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency defining a plurality of frame periods. The server VSYNC signal corresponding to generation of a plurality of video frames at the server during the plurality of frame periods. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending a plurality of compressed video frames based on the plurality of video frames from the server to the client over a network using the server VSYNC signal. The method including decoding and displaying, at the client, the plurality of compressed video frames. The method including analyzing the timing of one or more client operations to set the amount of frame buffering used by the client, as the client receives the plurality of compressed video frames.

公开(公告)号：US20210099713A1

公开(公告)日：2021-04-01

申请号：US17037425

申请日：2020-09-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Kelvin M. Yong

IPC: H04N19/142 ,  H04N19/179 ,  H04N19/177 ,  A63F13/352

Abstract: A method for encoding including executing game logic built on a game engine of a video game at a cloud gaming server to generate video frames. The method including executing scene change logic to predict a scene change in the video frames based on game state collected during execution of the game logic. The method including identifying a range of video frames that is predicted to include the scene change. The method including generating a scene change hint using the scene change logic, wherein the scene change hint identifies the range of video frames, wherein the range of video frames includes a first video frame. The method including delivering the first video frame to an encoder. The method including sending the scene change hint from the scene change logic to the encoder. The method including encoding the first video frame as an I-frame based on the scene change hint.

公开(公告)号：US12121803B2

公开(公告)日：2024-10-22

申请号：US18354483

申请日：2023-07-18

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Kelvin M. Yong

IPC: A63F13/355 ,  A63F13/335 ,  A63F13/358 ,  A63F13/44 ,  G07F17/32 ,  H04L65/70 ,  H04L65/80 ,  H04L67/10 ,  H04L67/1095 ,  H04L67/131 ,  H04N21/2343 ,  H04N21/242 ,  H04N21/43 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/478 ,  H04N21/8547

CPC classification number: A63F13/355 ,  A63F13/335 ,  A63F13/358 ,  A63F13/44 ,  G07F17/3225 ,  H04L65/70 ,  H04L65/80 ,  H04L67/10 ,  H04L67/1095 ,  H04L67/131 ,  H04N21/2343 ,  H04N21/242 ,  H04N21/4302 ,  H04N21/4402 ,  H04N21/4424 ,  H04N21/4781 ,  H04N21/8547 ,  A63F2300/534 ,  A63F2300/538 ,  A63F2300/638

Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency defining a plurality of frame periods. The server VSYNC signal corresponding to generation of a plurality of video frames at the server during the plurality of frame periods. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending a plurality of compressed video frames based on the plurality of video frames from the server to the client over a network using the server VSYNC signal. The method including decoding and displaying, at the client, the plurality of compressed video frames. The method including analyzing the timing of one or more client operations to set the amount of frame buffering used by the client, as the client receives the plurality of compressed video frames.

公开(公告)号：US20240139622A1

公开(公告)日：2024-05-02

申请号：US18408512

申请日：2024-01-09

Applicant: Sony Interactive Entertainment Inc.

Inventor： Kelvin M. Yong ,  Mark E. Cerny

IPC: A63F13/355 ,  A63F13/50 ,  H04N21/236 ,  H04N21/4385

CPC classification number: A63F13/355 ,  A63F13/50 ,  H04N21/23605 ,  H04N21/4385 ,  A63F2300/538

Abstract: A method for cloud gaming. The method including receiving one or more encoded slices of a video frame at a client, wherein the video frame was generated at a server while executing a video game, and encoded by an encoder at the server into the one or more encoded slices. The method including decoding a first encoded slice at a decoder of the client before fully receiving the one or more encoded slices of the video frame.

公开(公告)号：US20240082708A1

公开(公告)日：2024-03-14

申请号：US18516867

申请日：2023-11-21

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Kelvin M. Yong

IPC: A63F13/355 ,  A63F13/335 ,  A63F13/358 ,  A63F13/44 ,  G07F17/32 ,  H04L65/70 ,  H04L65/80 ,  H04L67/10 ,  H04L67/1095 ,  H04L67/131 ,  H04N21/2343 ,  H04N21/242 ,  H04N21/43 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/478 ,  H04N21/8547

CPC classification number: A63F13/355 ,  A63F13/335 ,  A63F13/358 ,  A63F13/44 ,  G07F17/3225 ,  H04L65/70 ,  H04L65/80 ,  H04L67/10 ,  H04L67/1095 ,  H04L67/131 ,  H04N21/2343 ,  H04N21/242 ,  H04N21/4302 ,  H04N21/4402 ,  H04N21/4424 ,  H04N21/4781 ,  H04N21/8547 ,  A63F2300/534 ,  A63F2300/538 ,  A63F2300/638

Abstract: A method of cloud gaming is disclosed. The method including receiving an encoded video frame at a client, wherein a server executes an application to generate a rendered video frame which is then encoded at an encoder at the server as the encoded video frame, wherein the encoded video frame includes one or more encoded slices that are compressed. The method including decoding the one or more encoded slices at a decoder of the client to generate one or more decoded slices. The method including rendering the one or more decoded slices for display at the client. The method including begin displaying the one or more decoded slices that are rendered before fully receiving the one or more encoded slices at the client.

公开(公告)号：US11865434B2

公开(公告)日：2024-01-09

申请号：US17001561

申请日：2020-08-24

Applicant: Sony Interactive Entertainment Inc.

Inventor： Kelvin M. Yong ,  Mark E. Cerny

IPC: A63F13/355 ,  H04N21/4385 ,  H04N21/236 ,  A63F13/50

CPC classification number: A63F13/355 ,  A63F13/50 ,  H04N21/23605 ,  H04N21/4385 ,  A63F2300/538

Abstract: A method for cloud gaming. The method including receiving one or more encoded slices of a video frame at a client, wherein the video frame was generated at a server while executing a video game, and encoded by an encoder at the server into the one or more encoded slices. The method including decoding a first encoded slice at a decoder of the client before fully receiving the one or more encoded slices of the video frame.

公开(公告)号：US11701584B2

公开(公告)日：2023-07-18

申请号：US17468512

申请日：2021-09-07

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Kelvin M. Yong

IPC: A63F13/355 ,  H04L67/10 ,  H04L65/80 ,  A63F13/358 ,  A63F13/44 ,  H04N21/242 ,  H04N21/43 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/8547 ,  H04L67/1095 ,  A63F13/335 ,  G07F17/32 ,  H04N21/2343 ,  H04N21/478 ,  H04L65/70 ,  H04L67/131

CPC classification number: A63F13/355 ,  A63F13/335 ,  A63F13/358 ,  A63F13/44 ,  G07F17/3225 ,  H04L65/70 ,  H04L65/80 ,  H04L67/10 ,  H04L67/1095 ,  H04L67/131 ,  H04N21/2343 ,  H04N21/242 ,  H04N21/4302 ,  H04N21/4402 ,  H04N21/4424 ,  H04N21/4781 ,  H04N21/8547 ,  A63F2300/534 ,  A63F2300/538 ,  A63F2300/638

Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency defining a plurality of frame periods. The server VSYNC signal corresponding to generation of a plurality of video frames at the server during the plurality of frame periods. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending a plurality of compressed video frames based on the plurality of video frames from the server to the client over a network using the server VSYNC signal. The method including decoding and displaying, at the client, the plurality of compressed video frames. The method including analyzing the timing of one or more client operations to set the amount of frame buffering used by the client, as the client receives the plurality of compressed video frames.

公开(公告)号：US11539960B2

公开(公告)日：2022-12-27

申请号：US17037425

申请日：2020-09-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Kelvin M. Yong

IPC: H04N19/142 ,  A63F13/352 ,  H04N19/177 ,  H04N19/179

Abstract: A method for encoding including executing game logic built on a game engine of a video game at a cloud gaming server to generate video frames. The method including executing scene change logic to predict a scene change in the video frames based on game state collected during execution of the game logic. The method including identifying a range of video frames that is predicted to include the scene change. The method including generating a scene change hint using the scene change logic, wherein the scene change hint identifies the range of video frames, wherein the range of video frames includes a first video frame. The method including delivering the first video frame to an encoder. The method including sending the scene change hint from the scene change logic to the encoder. The method including encoding the first video frame as an I-frame based on the scene change hint.

公开(公告)号：US20220152490A1

公开(公告)日：2022-05-19

申请号：US17590623

申请日：2022-02-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Kelvin M. Yong

IPC: A63F13/355 ,  H04L67/10 ,  H04L65/80 ,  H04L65/60 ,  H04L67/131 ,  A63F13/358 ,  A63F13/44 ,  H04N21/242 ,  H04N21/43 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/8547 ,  H04L67/1095 ,  A63F13/335 ,  G07F17/32 ,  H04N21/2343 ,  H04N21/478

Abstract: A method is disclosed including setting, at a plurality of devices, a plurality of VSYNC signals to a plurality of VSYNC frequencies, wherein a corresponding device VSYNC signal of a corresponding device is set to a corresponding device VSYNC frequency. The method including sending a plurality of signals between the plurality of devices, which are analyzed and used to adjust the relative timing between corresponding device VSYNC signals of at least two devices.

公开(公告)号：US20210228983A1

公开(公告)日：2021-07-29

申请号：US17229808

申请日：2021-04-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Kelvin M. Yong

IPC: A63F13/355 ,  H04L29/08 ,  H04L29/06 ,  A63F13/358 ,  A63F13/44 ,  H04N21/242 ,  H04N21/43 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/8547 ,  A63F13/335 ,  G07F17/32 ,  H04N21/2343 ,  H04N21/478

Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency. The server VSYNC signal corresponding to generation of video frames during frame periods for the server VSYNC frequency. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending compressed video frames from the server to the client over a network using the server VSYNC signal, wherein the compressed video frames are based on the generated video frames. The method including decoding and displaying, at the client, the compressed video frames. The method including analyzing the timing of one or more client operations to adjust the relative timing between the server VSYNC signal and the client VSYNC signal, as the client receives the compressed video frames.