公开(公告)号：US20180005429A1

公开(公告)日：2018-01-04

申请号：US15404074

申请日：2017-01-11

Applicant: Sony Interactive Entertainment Inc.

Inventor： Steven Osman ,  Javier Fernandez Rico ,  Ruxin Chen

IPC: G06T15/20 ,  G06F3/03 ,  G06T19/00 ,  G06T7/70 ,  G06T13/40 ,  G06F3/01

Abstract: Systems and methods for processing operations for head mounted display (HMD) users to join virtual reality (VR) scenes are provided. A computer-implemented method includes providing a first perspective of a VR scene to a first HMD of a first user and receiving an indication that a second user is requesting to join the VR scene provided to the first HMD. The method further includes obtaining real-world position and orientation data of the second HMD relative to the first HMD and then providing, based on said data, a second perspective of the VR scene. The method also provides that the first and second perspectives are each controlled by respective position and orientation changes while viewing the VR scene.

公开(公告)号：US12102921B2

公开(公告)日：2024-10-01

申请号：US17379511

申请日：2021-07-19

Applicant: Sony Interactive Entertainment Inc.

Inventor： Javier Fernandez Rico ,  Michael Taylor ,  Glenn Black

IPC: A63F13/00 ,  A63F13/67 ,  A63F13/798 ,  G06F18/214 ,  G06F18/24 ,  G06N3/08

CPC classification number: A63F13/67 ,  A63F13/798 ,  G06F18/214 ,  G06F18/24 ,  G06N3/08

Abstract: A method is provided, including: recording gameplay data from a first session of a video game, the first session defined for interactive gameplay of a user; training a machine learning model using the gameplay data, wherein the training causes the machine learning model to imitate the interactive gameplay of the user; after the training, determining a classification of the machine learning model by exposing the machine learning model to one or more scenarios of the video game, and evaluating actions of the machine learning model in response to the one or more scenarios; and, using the classification of the machine learning model to provide a coaching recommendation to the user.

公开(公告)号：US11934244B2

公开(公告)日：2024-03-19

申请号：US16294560

申请日：2019-03-06

Applicant: Sony Interactive Entertainment Inc.

Inventor： Glenn Black ,  Michael Taylor ,  Javier Fernandez Rico

IPC: G06F1/26 ,  A63F13/235 ,  A63F13/24 ,  A63F13/533 ,  A63F13/537 ,  G06F1/16 ,  G06F1/28

CPC classification number: G06F1/266 ,  G06F1/263 ,  G06F1/28 ,  A63F13/235 ,  A63F13/533 ,  A63F2300/1031 ,  A63F2300/308

Abstract: A warning is generated when a computer simulation controller is determined to have insufficient charge to permit use through an upcoming simulation sequence. Thus, responsive to a computer simulation having a first context and a computer simulation controller having a first voltage, a human-perceptible indication of low voltage is presented, whereas if the computer simulation has a second context typically requiring less input than the first context, no indication is presented if the controller has the same first voltage.

公开(公告)号：US20240004466A1

公开(公告)日：2024-01-04

申请号：US18470381

申请日：2023-09-19

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Young ,  Javier Fernandez Rico

IPC: G06F3/01 ,  G06N5/046 ,  G06T15/00

CPC classification number: G06F3/013 ,  G06F3/015 ,  G06N5/046 ,  G06T15/005

Abstract: A method for updating information for a graphics pipeline including executing in the first frame period an application on a CPU to generate primitives of a scene for a first video frame. Gaze tracking information is received in a second frame period for an eye of a user. In the second frame period a landing point on an HMD display is predicted at the CPU based at least on the gaze tracking information. A late update of the predicted landing point to a buffer accessible by the GPU is performed in the second frame period. Shader operations are performed in the GPU in the second frame period to generate pixel data based on the primitives and based on the predicted landing point, wherein the pixel data is stored into a frame buffer. The pixel data is scanned out in the third frame period from the frame buffer to the HMD.

公开(公告)号：US11801446B2

公开(公告)日：2023-10-31

申请号：US16355560

申请日：2019-03-15

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Javier Fernandez Rico ,  Glenn Black

IPC: A63F13/00 ,  A63F13/58 ,  A63F13/35 ,  G06N20/00

CPC classification number: A63F13/58 ,  A63F13/35 ,  G06N20/00 ,  A63F2300/65

Abstract: A method for training a character for a game is described. The method includes facilitating a display of one or more scenes of the game. The one or more scenes include the character and virtual objects. The method further includes receiving input data for controlling the character by a user to interact with the virtual objects and analyzing the input data to identify interaction patterns for the character in the one or more scenes. The interaction patterns define inputs to train an artificial intelligence (AI) model associated with a user account of the user. The method includes enabling the character to interact with a new scene based on the AI model. The method includes tracking the interaction with the new scene by the character to perform additional training of the AI model.

公开(公告)号：US11590416B2

公开(公告)日：2023-02-28

申请号：US16780858

申请日：2020-02-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black ,  Javier Fernandez Rico

IPC: A63F13/00 ,  A63F13/26 ,  G06T7/579 ,  G06T19/00 ,  A63F13/213 ,  A63F13/35 ,  A63F13/5378

Abstract: “Feature points” in “point clouds” that are visible to multiple respective cameras (i.e., aspects of objects imaged by the cameras) are reported via wired and/or wireless communication paths to a compositing processor which can determine whether a particular feature point “moved” a certain amount relative to another image. In this way, the compositing processor can determine, e.g., using triangulation and recognition of common features, how much movement occurred and where any particular camera was positioned when a latter image from that camera is captured. Thus, “overlap” of feature points in multiple images is used so that the system can close the loop to generate a SLAM map. The compositing processor, which may be implemented by a server or other device, generates the SLAM map by merging feature point data from multiple imaging devices.

公开(公告)号：US11210651B2

公开(公告)日：2021-12-28

申请号：US16870048

申请日：2020-05-08

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black ,  Javier Fernandez Rico

IPC: G06Q20/32 ,  G06F3/01 ,  G06K9/00

Abstract: Image data from two different devices is used to identify a physical interaction between two users to authenticate a digital interaction between the users.

公开(公告)号：US20210339146A1

公开(公告)日：2021-11-04

申请号：US17379511

申请日：2021-07-19

Applicant: Sony Interactive Entertainment Inc.

Inventor： Javier Fernandez Rico ,  Michael Taylor ,  Glenn Black

IPC: A63F13/798 ,  A63F13/67 ,  G06K9/62 ,  G06N3/08

Abstract: A method is provided, including: recording gameplay data from a first session of a video game, the first session defined for interactive gameplay of a user; training a machine learning model using the gameplay data, wherein the training causes the machine learning model to imitate the interactive gameplay of the user; after the training, determining a classification of the machine learning model by exposing the machine learning model to one or more scenarios of the video game, and evaluating actions of the machine learning model in response to the one or more scenarios; and, using the classification of the machine learning model to provide a coaching recommendation to the user.

公开(公告)号：US10942564B2

公开(公告)日：2021-03-09

申请号：US15982275

申请日：2018-05-17

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Young ,  Javier Fernandez Rico

IPC: G06F3/01 ,  G02B27/00 ,  G06F1/3231 ,  G06N3/04

Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.

公开(公告)号：US20200326776A1

公开(公告)日：2020-10-15

申请号：US16912686

申请日：2020-06-25

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black ,  Javier Fernandez Rico

IPC: G06F3/01 ,  A63F13/87 ,  G06T19/00

Abstract: Player-to-player eye contact is used to establish a private chat channel in an augmented reality (AR) or virtual reality (VR) setting. Since maintaining eye contact requires agreement from both parties, it allows both players an equal amount of control when performing the mutual action. Eye tracking may be used for determining whether mutual eye contact has been established. In the case of AR, “inside out” eye tracking can be used, whereas in a VR setting only inside eye tracking need be used. Techniques are described to confirm and establish a channel once eye contact has been held.