公开(公告)号：US20200035019A1

公开(公告)日：2020-01-30

申请号：US16517853

申请日：2019-07-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Matthew William Sanders ,  David Erwan Damien Uberti ,  Andrew William Walker

IPC: G06T17/00 ,  G06T7/70 ,  H04N13/111 ,  A63F13/52 ,  A63F13/497

Abstract: A method of generating an image includes receiving a video stream, the video stream having a two-dimensional video of a three-dimensional scene captured by a video camera; determining a mapping between locations in the two-dimensional video of the scene and locations in a three-dimensional representation of the scene, the mapping being determined based on a known parameter of the video camera and a known size of a feature in the three-dimensional scene; generating a three-dimensional graphical representation of the scene based on the determined mapping; determining a virtual camera angle from which the three-dimensional graphical representation of the scene is to be viewed; rendering an image corresponding to the graphical representation of the scene viewed from the determined virtual camera angle, and outputting the rendered image for display.

公开(公告)号：US12214277B2

公开(公告)日：2025-02-04

申请号：US16906198

申请日：2020-06-19

Applicant: Sony Interactive Entertainment Inc.

Inventor： Matthew William Sanders ,  Fabio Cappello ,  Timothy Bradley ,  Jessica Rose Grant ,  Maurizio Cerrato

IPC: A63F13/352 ,  A63F13/327 ,  A63F13/335 ,  A63F13/525 ,  A63F13/573 ,  G06N3/08 ,  G06N20/00

Abstract: A method of generating video frames for a cloud-based video game includes obtaining, via a communications network, a plurality of frames of a video game rendered at a cloud device; obtaining a player input received at an input device, the input device being used to play the video game, the player input being received in response to the display of at least one of the obtained video frames; inputting at least one of the obtained video frames and the player input to a prediction model; and synthesizing, based on the output of the prediction model, a subsequent frame for output at a display, and outputting the synthesized video frame at the display.

公开(公告)号：US20230127471A1

公开(公告)日：2023-04-27

申请号：US17964989

申请日：2022-10-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Matthew William Sanders ,  Justin Lim ,  Sahin Serdar Kocdemir ,  Marina Villanueva Barreiro

IPC: H04N21/442 ,  H04N19/42 ,  H04N21/4402 ,  H04N21/658

Abstract: A method of displaying streamed content includes receiving streamed content from a server, decoding the streamed content, outputting the decoded streamed content for display, and estimating a degree of attention of a user on the streamed content, where the decoding step comprises decoding the content to a quality that is dependent upon the estimated degree of attention of the use.

公开(公告)号：US11507184B2

公开(公告)日：2022-11-22

申请号：US17323059

申请日：2021-05-18

Applicant: Sony Interactive Entertainment Inc.

Inventor： Patrick John Connor ,  Matthew William Sanders ,  Mark Jacobus Breugelmans ,  Maria Chiara Monti

IPC: G06F3/01 ,  G06T3/40 ,  G06T5/00

Abstract: A head-mountable display (HMD) system includes at least one detector to detect movement of an eye of a user wearing the HMD, control circuitry to detect saccadic movement of the eye in dependence upon the detected movement of the eye, a display unit and a processor to generate images for display to the user by the display unit, in which the control circuitry is configured to control the processor in response to the detected saccadic movement, in which the control circuitry is configured to control the processor to adjust one or more image quality parameters for one or more of the images to be displayed by the display unit during the detected saccadic movement.

公开(公告)号：US20220148253A1

公开(公告)日：2022-05-12

申请号：US17452656

申请日：2021-10-28

Applicant: Sony Interactive Entertainment Inc.

Inventor： Matthew William Sanders ,  Maurizio Cerrato ,  Patrick John Connor ,  Mark Jacobus Breugelmans ,  Jessica Rose Grant

IPC: G06T15/20 ,  G06T15/00 ,  G02B27/01

Abstract: An image rendering system for generating one or more images of a virtual environment, the system comprising an object identifying unit operable to identify one or more objects in the virtual environment, and to identify one or more rendering parameters associated with each object, and a rendering unit operable to render an image comprising one or more of the identified objects in accordance with the corresponding rendering parameter, wherein the rendering parameter specifies a respective minimum level of detail with which the object is to be rendered.

公开(公告)号：US20210373657A1

公开(公告)日：2021-12-02

申请号：US17323059

申请日：2021-05-18

Applicant: Sony Interactive Entertainment Inc.

Inventor： Patrick John Connor ,  Matthew William Sanders ,  Mark Jacobus Breugelmans ,  Maria Chiara Monti

IPC: G06F3/01 ,  G06T3/40 ,  G06T5/00

Abstract: A head-mountable display (HMD) system includes at least one detector to detect movement of an eye of a user wearing the HMD, control circuitry to detect saccadic movement of the eye in dependence upon the detected movement of the eye, a display unit and a processor to generate images for display to the user by the display unit, in which the control circuitry is configured to control the processor in response to the detected saccadic movement, in which the control circuitry is configured to control the processor to adjust one or more image quality parameters for one or more of the images to be displayed by the display unit during the detected saccadic movement.

公开(公告)号：US10971115B2

公开(公告)日：2021-04-06

申请号：US16559965

申请日：2019-09-04

Applicant: Sony Interactive Entertainment Inc.

Inventor： Matthew William Sanders ,  Nigel John Williams ,  Richard James Forster ,  Andrew William Walker ,  Jessica Rose Grant

IPC: G09G5/373 ,  G06F3/01 ,  H04L29/08

Abstract: A foveated rendering system for modifying content to be displayed includes a user profile obtaining unit operable to obtain a user profile comprising information about head motion and eye motion for a user, and a foveated rendering unit operable to apply a foveated rendering process to the content to be displayed in dependence upon obtained user profile information.

公开(公告)号：US20200081526A1

公开(公告)日：2020-03-12

申请号：US16560000

申请日：2019-09-04

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew William Walker ,  Richard James Forster ,  Matthew William Sanders ,  Patrick John Connor ,  Jessica Rose Grant ,  Hans-Werner Gellersen ,  Ludwig Sidenmark

IPC: G06F3/01

Abstract: A user input system for controlling a viewpoint within displayed content includes a user profile obtaining unit operable to obtain a user profile having information about head motion and eye motion for a user, an input unit operable to receive user inputs relating to a change in viewpoint within displayed content, the user inputs including the user's head motion, and a viewpoint modification unit operable to modify the viewpoint in the displayed content in dependence upon received inputs and the user profile, where the modification to the viewpoint includes a greater motion than the head motion received as an input.