公开(公告)号：US10545338B2

公开(公告)日：2020-01-28

申请号：US15900759

申请日：2018-02-20

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Xiadong Mao ,  Glenn Black

IPC: G02B27/01 ,  G02B27/00 ,  A63F13/40 ,  G06F3/01 ,  A63F13/212 ,  G06F3/038

Abstract: Methods, systems, and computer programs are presented for rendering images on a head mounted display (HMD). One method includes operations for tracking, with one or more first cameras inside the HMD, the gaze of a user and for tracking motion of the HMD. The motion of the HMD is tracked by analyzing images of the HMD taken with a second camera that is not in the HMD. Further, the method includes an operation for predicting the motion of the gaze of the user based on the gaze and the motion of the HMD. Rendering policies for a plurality of regions, defined on a view rendered by the HMD, are determined based on the predicted motion of the gaze. The images are rendered on the view based on the rendering policies.

公开(公告)号：US20190361526A1

公开(公告)日：2019-11-28

申请号：US16533659

申请日：2019-08-06

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Young ,  Jeffrey Roger Stafford

IPC: G06F3/01 ,  H04N19/124 ,  G06F1/16 ,  G06F1/3234 ,  G06F3/03 ,  H04N19/167 ,  G06F3/147 ,  G02B27/01

Abstract: Gaze tracking data may representing a user's gaze with respect to one or more images transmitted to a user are analyzed to determine one or more regions of interest.The one or more transmitted images are selectively compressed so that fewer bits are needed to transmit data for portions of an image outside the one or more regions interest than for portions of the image within the one or more regions of interest.

公开(公告)号：US10456682B2

公开(公告)日：2019-10-29

申请号：US15714591

申请日：2017-09-25

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Javier Fernandez-Rico

IPC: A63F9/24 ,  A63F13/52 ,  A63F13/24 ,  A63F13/211 ,  A63F13/32 ,  A63F13/335 ,  A63F13/25 ,  A63F13/213 ,  G06T15/20 ,  G06T19/00

Abstract: An autonomous personal companion executing a method of projection including tracking within a reference system a current position and orientation of a gaming controller used for controlling game play of a gaming application played by a user, wherein the personal companion is configured to provide services to the user. The method includes receiving information related to the gaming application from a gaming console supporting the game play. The method includes generating content based on the information related to the gaming application. The method includes moving the autonomous personal companion to a location having a direct line of sight to the controller. The method includes projecting the content from the autonomous personal companion to a surface of the gaming controller.

公开(公告)号：US10169846B2

公开(公告)日：2019-01-01

申请号：US15087629

申请日：2016-03-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Andrew Young

IPC: G06T5/00 ,  G06F3/01 ,  G06F1/16 ,  G06F3/03 ,  G06T17/20 ,  G02B27/01

Abstract: Gaze tracking data representing a viewer's gaze with respect to one or more images presented to the viewer is used to generate foveated image data representing one or more foveated images characterized by a higher level of detail within one or more regions of interest and a lower level of detail outside the regions of interest. The image data for portions outside the one or more regions of interest is selectively filtered to reduce visual artifacts due to contrast resulting from the lower level of detail before compositing foveated images for presentation.

公开(公告)号：US10155166B1

公开(公告)日：2018-12-18

申请号：US15700005

申请日：2017-09-08

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Jeffrey Roger Stafford

IPC: A63F9/00 ,  A63F13/655 ,  A63F13/25 ,  G06F3/01

Abstract: A system is provided, including the following: a computing device that executes a video game and renders a primary video feed of the video game to a display device, the primary video feed providing a first view into a virtual space; a robot, including, a camera that captures images of a user, a projector, and, a controller that processes the images of the user to identify a gaze direction of the user; wherein when the gaze direction of the user changes from a first gaze direction that is directed towards the display device, to a second gaze direction that is directed away from the display device, the computing device generates a secondary video feed providing a second view into the virtual space; wherein the controller of the robot activates the projector to project the secondary video feed onto the projection surface in the local environment.

公开(公告)号：US20180357747A1

公开(公告)日：2018-12-13

申请号：US15727512

申请日：2017-10-06

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Young ,  Chris Ho ,  Jeffrey Roger Stafford

IPC: G06T3/00 ,  G06T1/20 ,  G06T7/00 ,  G06T7/66 ,  G06T7/70 ,  G06T13/80

CPC classification number: G06T3/0056 ,  G06T1/20 ,  G06T7/0002 ,  G06T7/66 ,  G06T7/70 ,  G06T13/80

Abstract: A method for implementing a graphics pipeline. The method includes generating a plurality of bones for an object defining positioning relationships between the bones. The method includes determining a subsystem of bones from the plurality of bones for the object. The method includes determining a foveal region when rendering an image of the virtual scene including the object, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the object is located in a peripheral region for the image. The method includes animating the object by applying a transformation to the subsystem of bones.

公开(公告)号：US20180342066A1

公开(公告)日：2018-11-29

申请号：US16052632

申请日：2018-08-02

Applicant: Sony Interactive Entertainment Inc.

Inventor： Dominic Saul Mallinson ,  Eric James Larsen ,  Jeffrey Roger Stafford

IPC: G06T7/20 ,  G06F3/01 ,  G06T7/70 ,  G06K9/00

Abstract: A method for tracking eye movement is provided. One embodiment of the method includes receiving a first measurement from a first sensor configured to detect a gaze location, determining an initial gaze location based at least on the first measurement, receiving at least one of eye motion amplitude and eye motion direction measurement from a second sensor, and determining an estimated gaze location based at least on the initial gaze location and the at least one of eye motion amplitude and eye motion direction. Systems perform similar steps, and non-transitory computer readable storage mediums each store one or more computer programs.

公开(公告)号：US10124257B2

公开(公告)日：2018-11-13

申请号：US15832678

申请日：2017-12-05

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford

IPC: A63F9/24 ,  A63F13/537 ,  A63F13/212 ,  A63F13/25 ,  G02B27/01 ,  A63F13/49 ,  A63F13/213 ,  A63F13/5255 ,  A63F13/533 ,  G06F3/01 ,  G06F3/03 ,  G06F3/0481 ,  A63F13/211 ,  A63F13/26 ,  G06F3/16

Abstract: Methods and systems for warning a user of a head mounted display (HMD) during game play of a video game. A game is executed causing interactive scenes of the game to be transmitted for rendering on a display portion of the HMD. Coordinates of the HMD are determined in a three-dimensional space of a real-world environment in which the user wearing the HMD is present, to identify a current position of the user. A movement of the HMD is determined during execution of the game by identifying a change in one or more coordinates of the HMD in the three-dimensional space. When it is determined that the user is approaching a boundary of an interaction space in a real-world environment, a warning signal is conveyed to the HMD to indicate proximity of the user to the boundary of the interaction space.

公开(公告)号：US20180314323A1

公开(公告)日：2018-11-01

申请号：US16027211

申请日：2018-07-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Anton Mikhailov ,  Eric Larsen ,  Jeffrey Roger Stafford

IPC: G06F3/01 ,  G06T7/246 ,  G06T7/73 ,  G02B27/00 ,  G02B27/01 ,  G06T19/00 ,  G06F3/0346

CPC classification number: G06F3/012 ,  G02B27/0093 ,  G02B27/017 ,  G02B27/0172 ,  G06F3/0346 ,  G06T7/251 ,  G06T7/73 ,  G06T19/006 ,  G06T2207/10016 ,  G06T2207/30204

Abstract: A head mounted display is provided. The head mounted display includes an optics block having a display screen. The optics block has a forward-facing region, a lower-facing region, a top-facing region, an inside-facing region, and side regions that extend from the forward-facing region toward the inside-facing region. The display screen is viewable from the inside-facing region. A band adjustment unit is located opposite the optics block. A headband has a front portion and an adjustable portion. The adjustable portion of the headband is connected to the band adjustment unit to contract a size of the headband or expand the size of the headband. The front portion of the headband has a connection to the top-facing region of the optics block that is proximate to the inside-facing region. A pad is disposed inside of the front portion of the headband. The pad provides for at least partial support of the optics block when the head mounted display is worn by a user.

公开(公告)号：US20180292911A1

公开(公告)日：2018-10-11

申请号：US16005496

申请日：2018-06-11

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Todd Tokubo

IPC: G06F3/01 ,  G06K9/00 ,  A63F13/211 ,  G06F3/03 ,  A63F13/212 ,  A63F13/213 ,  A63F13/5255

Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.