公开(公告)号：US20230103010A1

公开(公告)日：2023-03-30

申请号：US18076326

申请日：2022-12-06

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Kelvin M. Yong

IPC: A63F13/355 ,  H04N21/478 ,  H04N21/442 ,  H04L65/70 ,  A63F13/335 ,  H04L65/80 ,  H04N21/43 ,  H04L67/1095 ,  H04N21/2343 ,  A63F13/44 ,  G07F17/32 ,  H04N21/8547 ,  H04L67/10 ,  H04N21/242 ,  H04N21/4402 ,  A63F13/358 ,  H04L67/131

Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency. The server VSYNC signal corresponding to generation of video frames during frame periods for the server VSYNC frequency. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending compressed video frames from the server to the client over a network using the server VSYNC signal, wherein the compressed video frames are based on the generated video frames. The method including decoding and displaying, at the client, the compressed video frames. The method including analyzing the timing of one or more client operations to adjust the relative timing between the server VSYNC signal and the client VSYNC signal, as the client receives the compressed video frames.

公开(公告)号：US20220401835A1

公开(公告)日：2022-12-22

申请号：US17893707

申请日：2022-08-23

Applicant: Sony Interactive Entertainment Inc.

Inventor： Kelvin M. Yong ,  Mark E. Cerny

IPC: A63F13/355 ,  H04N21/4385 ,  H04N21/236 ,  A63F13/50

Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including scanning-in the video frame to an encoder at the server scanline-by-scanline. The method including encoding one or more encoder slices as one or more encoded slices at the encoder, wherein each encoded slice is delivered to a buffer at an encoder fill rate. The method including draining a first encoded slice from the buffer to stream the first encoded slice at a buffer drain rate over a network to a client, wherein the first encoded slice is streamed over the network before fully encoding the one or more slices of the video frame.

公开(公告)号：US11321800B2

公开(公告)日：2022-05-03

申请号：US16780566

申请日：2020-02-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Florian Strauss ,  Tobias Berghoff

IPC: G06T1/20

Abstract: A method for graphics processing. The method including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including dividing responsibility for the rendering geometry of the graphics between the plurality of GPUs based on a plurality of screen regions, each GPU having a corresponding division of the responsibility which is known to the plurality of GPUs. The method including generating information regarding a piece of geometry with respect to a first screen region for which a first GPU has a first division of responsibility, while rendering the piece of geometry at a second GPU for an image. The method including rendering the piece of geometry at the first GPU using the information.

公开(公告)号：US20220005148A1

公开(公告)日：2022-01-06

申请号：US17482198

申请日：2021-09-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Tobias Berghoff ,  David Simpson

IPC: G06T1/20 ,  G06T15/00 ,  G06F9/50 ,  G06T17/10 ,  G06F9/38 ,  G06T15/10

Abstract: A method for graphics processing. The method including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including using the plurality of GPUs in collaboration to render an image frame including a plurality of pieces of geometry. The method including during a pre-pass phase of rendering, generating information at the GPUs regarding the plurality of pieces of geometry and their relation to a plurality of screen regions. The method including assigning the plurality of screen regions to the plurality of GPUs based on the information for purposes of rendering the plurality of pieces of geometry in a subsequent phase of rendering.

公开(公告)号：US20220005146A1

公开(公告)日：2022-01-06

申请号：US17475314

申请日：2021-09-14

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny

IPC: G06T1/20 ,  G06T15/00 ,  G06T15/10 ,  G06F9/54 ,  G06F9/48 ,  G06F9/38 ,  G06T17/10

Abstract: A method for graphics processing. The method including rendering graphics for an application using graphics processing units (GPUs). The method including using the plurality of GPUs in collaboration to render an image frame including a plurality of pieces of geometry. The method including during the rendering of the image frame, subdividing one or more of the plurality of pieces of geometry into smaller pieces, and dividing the responsibility for rendering these smaller portions of geometry among the plurality of GPUs, wherein each of the smaller portions of geometry is processed by a corresponding GPU. The method including for those pieces of geometry that are not subdivided, dividing the responsibility for rendering the pieces of geometry among the plurality of GPUs, wherein each of these pieces of geometry is processed by a corresponding GPU.

公开(公告)号：US20210354031A1

公开(公告)日：2021-11-18

申请号：US17336282

申请日：2021-06-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Kelvin M. Yong

IPC: A63F13/355 ,  H04L29/08 ,  H04L29/06 ,  A63F13/358 ,  A63F13/44 ,  H04N21/242 ,  H04N21/43 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/8547 ,  A63F13/335 ,  G07F17/32 ,  H04N21/2343 ,  H04N21/478

Abstract: A method of cloud gaming is disclosed. The method including receiving an encoded video frame at a client, wherein a server executes an application to generate a rendered video frame which is then encoded at an encoder at the server as the encoded video frame, wherein the encoded video frame includes one or more encoded slices that are compressed. The method including decoding the one or more encoded slices at a decoder of the client to generate one or more decoded slices. The method including rendering the one or more decoded slices for display at the client. The method including begin displaying the one or more decoded slices that are rendered before fully receiving the one or more encoded slices at the client.

公开(公告)号：US20210241515A1

公开(公告)日：2021-08-05

申请号：US16780798

申请日：2020-02-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Tobias Berghoff ,  David Simpson

IPC: G06T15/00

Abstract: A method for graphics processing. The method including rendering graphics for an application using graphics processing units (GPUs). The method including dividing responsibility for processing a plurality of pieces of geometry of an image frame during an analysis pre-pass phase of rendering between the plurality of GPUs, wherein each of the plurality of pieces of geometry is assigned to a corresponding GPU. The method including determining in the analysis pre-pass phase overlap of each the plurality of pieces of geometry with each of a plurality of screen regions. The method including generating information at the plurality of GPUs regarding the plurality of pieces of geometry and their relations to the plurality of screen regions based on the overlap of each the plurality of pieces of geometry with each of the plurality of screen regions. The method including assigning the plurality of screen regions to the plurality of GPUs based on the information for purposes of rendering the plurality of pieces of geometry during a subsequent phase of rendering.

公开(公告)号：US20210241415A1

公开(公告)日：2021-08-05

申请号：US16780776

申请日：2020-02-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Tobias Berghoff ,  David Simpson

IPC: G06T1/20 ,  G06T15/00 ,  G06T15/10 ,  G06T17/10 ,  G06F9/38 ,  G06F9/50

Abstract: A method for graphics processing. The method including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including using the plurality of GPUs in collaboration to render an image frame including a plurality of pieces of geometry. The method including during a pre-pass phase of rendering, generating information at the GPUs regarding the plurality of pieces of geometry and their relation to a plurality of screen regions. The method including assigning the plurality of screen regions to the plurality of GPUs based on the information for purposes of rendering the plurality of pieces of geometry in a subsequent phase of rendering.

公开(公告)号：US20210241410A1

公开(公告)日：2021-08-05

申请号：US16780566

申请日：2020-02-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Florian Strauss ,  Tobias Berghoff

IPC: G06T1/20

Abstract: A method for graphics processing. The method including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including dividing responsibility for the rendering geometry of the graphics between the plurality of GPUs based on a plurality of screen regions, each GPU having a corresponding division of the responsibility which is known to the plurality of GPUs. The method including generating information regarding a piece of geometry with respect to a first screen region for which a first GPU has a first division of responsibility, while rendering the piece of geometry at a second GPU for an image. The method including rendering the piece of geometry at the first GPU using the information.

公开(公告)号：US11080814B1

公开(公告)日：2021-08-03

申请号：US16780722

申请日：2020-02-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark E. Cerny ,  Florian Strauss ,  Tobias Berghoff

IPC: G06T1/20 ,  G06T15/00 ,  G06T15/10 ,  G06F17/18 ,  G06F9/38 ,  G06F9/50 ,  G06T17/10

Abstract: A method including rendering graphics for an application using graphics processing units (GPUs). Responsibility for rendering of geometry is divided between GPUs based on screen regions, each GPU having a corresponding division of the responsibility which is known. First pieces of geometry are rendered at the GPUs during a rendering phase of a previous image frame. Statistics are generated for the rendering of the previous image frame. Second pieces of geometry of a current image frame are assigned based on the statistics to the GPUs for geometry testing. Geometry testing at a current image frame on the second pieces of geometry is performed to generate information regarding each piece of geometry and its relation to each screen region, the geometry testing performed at each of the GPUs based on the assigning. The information generated for the second pieces of geometry is used when rendering the geometry at the GPUs.