公开(公告)号：US11420118B2

公开(公告)日：2022-08-23

申请号：US17001547

申请日：2020-08-24

Applicant: Sony Interactive Entertainment Inc.

Inventor： Kelvin M. Yong ,  Mark E. Cerny

IPC: A63F13/355 ,  H04N21/4385 ,  H04N21/236 ,  A63F13/50

Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including scanning-in the video frame to an encoder at the server scanline-by-scanline. The method including encoding one or more encoder slices as one or more encoded slices at the encoder, wherein each encoded slice is delivered to a buffer at an encoder fill rate. The method including draining a first encoded slice from the buffer to stream the first encoded slice at a buffer drain rate over a network to a client, wherein the first encoded slice is streamed over the network before fully encoding the one or more slices of the video frame.

公开(公告)号：US11263718B2

公开(公告)日：2022-03-01

申请号：US16780680

申请日：2020-02-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Florian Strauss ,  Tobias Berghoff

IPC: G06T1/20

Abstract: A method for graphics processing. The method including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including dividing responsibility for the rendering of geometry of the graphics between the plurality of GPUs based on a plurality of screen regions that are interleaved, each GPU having a corresponding division of the responsibility which is known to the plurality of GPUs. The method including assigning a GPU a piece of geometry of an image frame generated by an application for geometry pretesting. The method including performing geometry pretesting at the GPU to generate information regarding the piece of geometry and its relation to each of the plurality of screen regions. The method including using the information at each of the plurality of GPUs when rendering the image frame.

公开(公告)号：US20210358075A1

公开(公告)日：2021-11-18

申请号：US17389311

申请日：2021-07-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Florian Strauss ,  Tobias Berghoff

IPC: G06T1/20 ,  G06T15/00 ,  G06T15/10 ,  G06T17/10 ,  G06F9/38 ,  G06F9/50 ,  G06F17/18

Abstract: A method including rendering graphics for an application using graphics processing units (GPUs). Responsibility for rendering of geometry is divided between GPUs based on screen regions, each GPU having a corresponding division of the responsibility which is known. First pieces of geometry are rendered at the GPUs during a rendering phase of a previous image frame. Statistics are generated for the rendering of the previous image frame. Second pieces of geometry of a current image frame are assigned based on the statistics to the GPUs for geometry testing. Geometry testing at a current image frame on the second pieces of geometry is performed to generate information regarding each piece of geometry and its relation to each screen region, the geometry testing performed at each of the GPUs based on the assigning. The information generated for the second pieces of geometry is used when rendering the geometry at the GPUs.

公开(公告)号：US11170461B2

公开(公告)日：2021-11-09

申请号：US16780776

申请日：2020-02-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Tobias Berghoff ,  David Simpson

IPC: G06T1/20 ,  G06T15/00 ,  G06F9/50 ,  G06T17/10 ,  G06F9/38 ,  G06T15/10

Abstract: A method for graphics processing. The method including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including using the plurality of GPUs in collaboration to render an image frame including a plurality of pieces of geometry. The method including during a pre-pass phase of rendering, generating information at the GPUs regarding the plurality of pieces of geometry and their relation to a plurality of screen regions. The method including assigning the plurality of screen regions to the plurality of GPUs based on the information for purposes of rendering the plurality of pieces of geometry in a subsequent phase of rendering.

公开(公告)号：US11110349B2

公开(公告)日：2021-09-07

申请号：US16696125

申请日：2019-11-26

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Kelvin M. Yong

IPC: A63F13/355 ,  H04L29/08 ,  H04L29/06 ,  A63F13/358 ,  A63F13/44 ,  H04N21/242 ,  H04N21/43 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/8547 ,  A63F13/335 ,  G07F17/32 ,  H04N21/2343 ,  H04N21/478

Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency defining a plurality of frame periods. The server VSYNC signal corresponding to generation of a plurality of video frames at the server during the plurality of frame periods. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending a plurality of compressed video frames based on the plurality of video frames from the server to the client over a network using the server VSYNC signal. The method including decoding and displaying, at the client, the plurality of compressed video frames. The method including analyzing the timing of one or more client operations to set the amount of frame buffering used by the client, as the client receives the plurality of compressed video frames.

公开(公告)号：US20210241414A1

公开(公告)日：2021-08-05

申请号：US16780745

申请日：2020-02-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Florian Strauss ,  Tobias Berghoff

IPC: G06T1/20 ,  G06T15/00 ,  G06T15/10 ,  G06T17/10 ,  G06F9/38 ,  G06F9/50 ,  G06F9/46

Abstract: A method including rendering graphics for an application using graphics processing units (GPUs). Responsibility for rendering of geometry is divided between GPUs based on screen regions, each GPU having a corresponding division of the responsibility which is known. A plurality of pieces of geometry of an image frame is assigned to the GPUs for geometry testing. A first GPU state configuring one or more shaders to perform the geometry testing is set. Geometry testing is performed at GPUs on the plurality of pieces of geometry to generate information regarding each piece of geometry and its relation to each of the plurality of screen regions. A second GPU state configuring the one or more shaders to perform rendering is set. The information generated for each of the plurality of pieces of geometry is used when rendering the plurality of pieces of geometry at the GPUs.

公开(公告)号：US20210099713A1

公开(公告)日：2021-04-01

申请号：US17037425

申请日：2020-09-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Kelvin M. Yong

IPC: H04N19/142 ,  H04N19/179 ,  H04N19/177 ,  A63F13/352

Abstract: A method for encoding including executing game logic built on a game engine of a video game at a cloud gaming server to generate video frames. The method including executing scene change logic to predict a scene change in the video frames based on game state collected during execution of the game logic. The method including identifying a range of video frames that is predicted to include the scene change. The method including generating a scene change hint using the scene change logic, wherein the scene change hint identifies the range of video frames, wherein the range of video frames includes a first video frame. The method including delivering the first video frame to an encoder. The method including sending the scene change hint from the scene change logic to the encoder. The method including encoding the first video frame as an I-frame based on the scene change hint.

公开(公告)号：US20210093962A1

公开(公告)日：2021-04-01

申请号：US17008482

申请日：2020-08-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Roelof Roderick Colenbrander ,  Mark E. Cerny

IPC: A63F13/355 ,  A63F13/358 ,  A63F13/52

Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server, wherein the video frame is stored in a frame buffer. The method including determining a maximum pixel clock for a chip-set including a scan-out block. The method including determining a frame rate setting based on the maximum pixel clock and an image size of a target display of a client. The method including determining a speed setting value for the chip-set. The method including scanning the video frame into the scan-out block from the frame buffer. The method including scanning-out the video frame from the scan-out block to the encoder at the speed setting value.

公开(公告)号：US20210093961A1

公开(公告)日：2021-04-01

申请号：US17008463

申请日：2020-08-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Roelof Roderick Colenbrander ,  Mark E. Cerny

IPC: A63F13/355 ,  A63F13/52 ,  A63F13/358

Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including performing a scan-out process by scanning the video frame scanline-by-scanline and one or more user interface features scanline-by-scanline to one or more input frame buffers, and compositing and blending the video frame and the one or more user interface features into a modified video frame. The method including scanning in the scan-out process the modified video frame to an encoder at the server scanline-by-scanline The method including beginning in the scan-out process scanning the video frame and the one or more user interface features to the one or more input frame buffers at a corresponding flip-time for the video frame.