公开(公告)号：US10228562B2

公开(公告)日：2019-03-12

申请号：US14835558

申请日：2015-08-25

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Eric Larsen

IPC: G02B27/00 ,  G02B27/01

Abstract: Systems and methods include receiving an image for presenting on a display screen of a head mounted display (HMD). The image is provided by an application. The received image is pre-distorted to enable optics provided in a HMD to render the image. An alignment offset is identified for an eye of a user wearing the HMD by determining a position of the eye relative to an optical axis of at least one lens of the optics of the HMD. The pre-distorted image provided by the application is adjusted to define a corrected pre-distorted image that accounts for the alignment offset. The corrected pre-distorted image is forwarded to the display screen of the HMD for rendering, such that the image presented through the optics of the HMD removes aberrations caused by the alignment offset.

公开(公告)号：US20190070506A1

公开(公告)日：2019-03-07

申请号：US16181183

申请日：2018-11-05

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford

IPC: A63F13/537 ,  G06F3/0481 ,  G06F3/01 ,  A63F13/26 ,  A63F13/211 ,  A63F13/533 ,  A63F13/5255 ,  A63F13/213 ,  A63F13/49 ,  G02B27/01 ,  A63F13/25 ,  A63F13/212 ,  G06F3/16 ,  G06F3/03

CPC classification number: A63F13/537 ,  A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/25 ,  A63F13/26 ,  A63F13/49 ,  A63F13/5255 ,  A63F13/533 ,  A63F2300/306 ,  A63F2300/538 ,  G02B27/017 ,  G06F3/011 ,  G06F3/012 ,  G06F3/016 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/04815 ,  G06F3/16

Abstract: Methods and systems for warning a user of a head mounted display (HMD) during game play of a video game. A game is executed causing interactive scenes of the game to be transmitted for rendering on a display portion of the HMD. Coordinates of the HMD are determined in a three-dimensional space of a real-world environment in which the user wearing the HMD is present, to identify a current position of the user. A movement of the HMD is determined during execution of the game by identifying a change in one or more coordinates of the HMD in the three-dimensional space. When it is determined that the user is approaching a boundary of an interaction space in a real-world environment, a warning signal is conveyed to the HMD to indicate proximity of the user to the boundary of the interaction space.

公开(公告)号：US20180357810A1

公开(公告)日：2018-12-13

申请号：US15721580

申请日：2017-09-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Young ,  Chris Ho ,  Jeffrey Roger Stafford

IPC: G06T15/00 ,  G06T11/40 ,  G06F3/01

CPC classification number: G06T15/005 ,  G06F3/013 ,  G06T11/40 ,  G06T2210/36 ,  G06T2210/56 ,  G06T2215/16

Abstract: A method for implementing a graphics pipeline. The method includes generating a system of particles creating an effect in a virtual scene, the system of particles comprising a plurality of particle geometries. The method includes determining a subsystem of particles from the system of particles, the subsystem of particles comprising a subset of particle geometries taken from the plurality of particle geometries. The method includes determining a foveal region when rendering an image of the virtual scene, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the effect is located in the peripheral region for the image. The method includes rendering the subsystem of particles to generate the effect.

公开(公告)号：US20180357780A1

公开(公告)日：2018-12-13

申请号：US15727505

申请日：2017-10-06

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Young ,  Chris Ho ,  Jeffrey Roger Stafford

IPC: G06T7/66 ,  G06T7/00 ,  G06T7/20 ,  G06T7/73 ,  G06T11/20 ,  G06T13/80

CPC classification number: G06T7/66 ,  G06T7/0002 ,  G06T7/20 ,  G06T7/73 ,  G06T11/20 ,  G06T13/80

Abstract: A method for implementing a graphics pipeline. The method includes building a first shadow map of high resolution, and building a second shadow map based on the first shadow map of lower resolution. The method includes determining a light source affecting a virtual scene, and projecting geometries of objects of an image of the virtual scene onto a plurality of pixels of a display from a first point-of-view. The method includes determining a foveal region when rendering the image, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining a first set of geometries is drawn to a first pixel, determining the first set of geometries is in shadow based on the light source, and determining the first set of geometries is outside of the foveal region. The method includes rendering the first set of geometries using the second shadow map.

公开(公告)号：US10073516B2

公开(公告)日：2018-09-11

申请号：US14745267

申请日：2015-06-19

Applicant: Sony Interactive Entertainment Inc.

Inventor： Eric Larsen ,  Frederick Umminger ,  Xiaoyong Ye ,  Noam Rimon ,  Jeffrey Roger Stafford ,  Xia Lou

IPC: G06F3/01 ,  G06F3/0346 ,  G06T19/00 ,  G02B27/01 ,  G06F1/16 ,  G02B27/00

CPC classification number: G06F3/012 ,  G02B27/0093 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0187 ,  G06F1/163 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G06T19/006

Abstract: Inertial sensors within a head mounted display are used to track movement of the head mounted display. The tracked movement of the head mounted display is correlated to an action within a virtual reality scene that is currently displayed to a user wearing the head mounted display. The action within the virtual reality scene is based on a context of the virtual reality scene that is currently displayed. The detected movement of the head mounted display can be combined with other sensor data, such as gaze detection data, to determine the action within the virtual reality scene. In this manner, movements of the user as detected using the inertial sensors within the head mounted display are used as inputs to cause actions within the current context of the virtual reality scene as displayed within the head mounted display to the user.

公开(公告)号：US09996166B2

公开(公告)日：2018-06-12

申请号：US15694511

申请日：2017-09-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Todd Tokubo

IPC: A63F9/24 ,  G06F3/01

CPC classification number: G06F3/017 ,  A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/5255 ,  A63F2300/1012 ,  A63F2300/1031 ,  A63F2300/1087 ,  A63F2300/1093 ,  A63F2300/301 ,  A63F2300/303 ,  A63F2300/308 ,  A63F2300/538 ,  G06F3/011 ,  G06F3/014 ,  G06F3/0304 ,  G06K9/00382

Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.

公开(公告)号：US20170315611A1

公开(公告)日：2017-11-02

申请号：US15653465

申请日：2017-07-18

Applicant: Sony Interactive Entertainment Inc.

Inventor： Anton Mikhailov ,  Eric Larsen ,  Jeffrey Roger Stafford

IPC: G06F3/01 ,  G06T7/246 ,  G02B27/00 ,  G06F3/0346 ,  G06T7/73 ,  G02B27/01 ,  G06T19/00

Abstract: Methods and systems are provided for head mounted display (HMD) implementations. One example implementation includes a circuit for communicating with a computing system that processes multimedia content for display in the HMD. A front unit of the HMD has a screen for displaying multimedia content, and the front unit has a set of LEDs. A rear section of the HMD has a set of LEDs. A connector is provided for coupling the front unit with the rear section of the HMD, such that adjustment of the connector changes a separation distance between at least one of the set of LEDs of the front unit and at least one of the set of LEDs of the rear section. The computing system processes image data captured of the HMD when worn by a user. The image data includes at least one of the set of LEDs of the front unit and at least one of the set of LEDs of the rear section to identify the separation distance for a current adjustment of the connector.

公开(公告)号：US20170209786A1

公开(公告)日：2017-07-27

申请号：US15482669

申请日：2017-04-07

Applicant: Sony Interactive Entertainment Inc.

Inventor： Yunpeng Zhu ,  Jeffrey Roger Stafford ,  Steven Osman

IPC: A63F13/211 ,  A63F13/428 ,  A63F13/63 ,  A63F13/25 ,  A63F13/352

CPC classification number: A63F13/211 ,  A63F13/10 ,  A63F13/12 ,  A63F13/25 ,  A63F13/26 ,  A63F13/327 ,  A63F13/352 ,  A63F13/355 ,  A63F13/428 ,  A63F13/47 ,  A63F13/63 ,  A63F13/92 ,  A63F2300/301 ,  A63F2300/403 ,  A63F2300/538 ,  A63F2300/632 ,  A63F2300/8082

Abstract: In one implementation, a portable device is provided, including: a sensor configured to generate sensor data for determining and tracking a position and orientation of the portable device during an interactive session of a virtual reality program presented on a main display, the interactive session being defined for interactivity between a user and the virtual reality program; a communications module configured to send the sensor data to a computing device, the communications module being further configured to receive from the computing device an ancillary video stream of the interactive session that is generated based on a state of the virtual reality program and the tracked position and orientation of the portable device.

公开(公告)号：US20250053236A1

公开(公告)日：2025-02-13

申请号：US18928758

申请日：2024-10-28

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Young ,  Jeffrey Roger Stafford

IPC: G06F3/01 ,  G02B27/01 ,  G06F1/16 ,  G06F1/3234 ,  G06F3/03 ,  G06F3/147 ,  H04N19/124 ,  H04N19/167

Abstract: Gaze tracking data representing a user's gaze is analyzed to determine one or more regions of interest. One or more gaze tracking parameters are determined from the gaze tracking data. Adjusted foveation data is determined representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking parameters. The compression of the one or more transmitted images is adjusted so that fewer bits are needed to transmit data for portions of an image outside the one or more regions of interest than for portions of the image within the one or more regions of interest. Adjusting compression of the transmitted image(s) includes decreasing a size of the foveal region for a subset of the one or more images that are presented to the user during the saccade or blink.

公开(公告)号：US11899835B2

公开(公告)日：2024-02-13

申请号：US17944145

申请日：2022-09-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Frederick Umminger ,  Richard Marks

IPC: G06F16/9535 ,  G06F3/01 ,  G06F16/954 ,  G02B27/01 ,  G06F3/03 ,  G06F3/0487 ,  G06F3/16 ,  G06T13/40 ,  G06T19/00 ,  G09G5/377

CPC classification number: G06F3/011 ,  G02B27/017 ,  G06F3/0304 ,  G06F3/0487 ,  G06F3/16 ,  G06F16/954 ,  G06F16/9535 ,  G06T13/40 ,  G06T19/006 ,  G09G5/377

Abstract: Methods and systems for filtering content include identifying content for presenting in a rendering space defined by one or more mechanisms of a head mounted display (HMD), wherein the content is interactive, streaming content. A rating score for the content is identified. The content is dynamically adjusted to selectively filter a portion of the content based on a user profile of the user, rating score of the content, and ongoing interactions detected at the content. The adjusted content is formatted for rendering on the HMD. The formatted content is automatically transmitted to the HMD for rendering, in response to the request.