公开(公告)号：US10019057B2

公开(公告)日：2018-07-10

申请号：US14206219

申请日：2014-03-12

Applicant: Sony Interactive Entertainment Inc.

Inventor： Steven Osman ,  Xiadong Mao ,  Jeffrey Roger Stafford

IPC: G02B27/01 ,  G06F3/01 ,  G06T19/00 ,  G02B27/00

CPC classification number: G06F3/013 ,  G02B27/0093 ,  G02B27/017 ,  G02B27/0172 ,  G02B27/0179 ,  G02B2027/0187 ,  G06F2203/04804 ,  G06T19/006

Abstract: Methods, systems, and computer programs are presented for managing the display of images on a head mounted device (HMD). One method includes an operation for tracking the gaze of a user wearing the HMD, where the HMD is displaying a scene of a virtual world. In addition, the method includes an operation for detecting that the gaze of the user is fixed on a predetermined area for a predetermined amount of time. In response to the detecting, the method fades out a region of the display in the HMD, while maintaining the scene of the virtual world in an area of the display outside the region. Additionally, the method includes an operation for fading in a view of the real world in the region as if the HMD were transparent to the user while the user is looking through the region. The fading in of the view of the real world includes maintaining the scene of the virtual world outside the region.

公开(公告)号：US09987554B2

公开(公告)日：2018-06-05

申请号：US14657639

申请日：2015-03-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Todd Tokubo

IPC: A63F13/213 ,  G06F3/01 ,  A63F13/215 ,  A63F13/25 ,  A63F13/428 ,  A63F13/26 ,  A63F13/23 ,  A63F13/24 ,  A63F13/426 ,  A63F13/5255 ,  A63F13/98 ,  G06F3/03 ,  G06F3/0488

CPC classification number: A63F13/213 ,  A63F13/215 ,  A63F13/23 ,  A63F13/24 ,  A63F13/25 ,  A63F13/26 ,  A63F13/426 ,  A63F13/428 ,  A63F13/5255 ,  A63F13/98 ,  A63F2300/538 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/04883 ,  G06F2203/04101

Abstract: A method for enhancing detection of a user's hand relative to a head-mounted display (HMD) is described. The method includes sensing a disrupted portion of energy by sensors integrated within a pad device. The disrupted portion of the energy is generated when the hand of the user interferes with the energy. The plurality of sensors that sense the disrupted portion of the energy produce an energy image that mirrors a current position of the hand. The method includes repeating the sensing continuously to produce a stream of energy images. The method includes communicating the stream of energy images to a game console for processing each of the energy images to produce a model of the hand and movement of the model of the hand. The model of the hand is at least partially rendered as a virtual hand in a virtual environment that is displayed in the HMD.

公开(公告)号：US09984505B2

公开(公告)日：2018-05-29

申请号：US14503196

申请日：2014-09-30

Applicant: Sony Interactive Entertainment Inc.

Inventor： Noam Rimon ,  Jeffrey Roger Stafford

IPC: G06T19/00 ,  G02B27/01 ,  G06F3/01 ,  G06T11/60 ,  G06F3/041 ,  G06F3/0488 ,  G06F3/0484

CPC classification number: G06T19/006 ,  G02B27/017 ,  G02B2027/0178 ,  G06F3/012 ,  G06F3/013 ,  G06F3/017 ,  G06F3/041 ,  G06F3/04845 ,  G06F3/0488 ,  G06F2203/04806 ,  G06Q10/10 ,  G06Q50/01 ,  G06T11/60

Abstract: A method for presenting text information on a head-mounted display is provided, comprising: rendering a view of a virtual environment to the head-mounted display; tracking an orientation of the head-mounted display; tracking a gaze of a user of the head-mounted display; processing the gaze of the user and the orientation of the head-mounted display, to identify a gaze target in the virtual environment towards which the gaze of the user is directed; receiving text information for rendering on the head-mounted display; presenting the text information in the virtual environment in a vicinity of the gaze target.

公开(公告)号：US09908049B2

公开(公告)日：2018-03-06

申请号：US15088000

申请日：2016-03-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford

IPC: A63F9/24 ,  A63F13/537 ,  A63F13/212 ,  A63F13/25 ,  G02B27/01 ,  A63F13/49 ,  A63F13/213 ,  A63F13/5255 ,  A63F13/533 ,  G06F3/01 ,  G06F3/03 ,  G06F3/0481 ,  A63F13/211 ,  A63F13/26

CPC classification number: A63F13/537 ,  A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/25 ,  A63F13/26 ,  A63F13/49 ,  A63F13/5255 ,  A63F13/533 ,  A63F2300/306 ,  A63F2300/538 ,  G02B27/017 ,  G06F3/011 ,  G06F3/012 ,  G06F3/016 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/04815 ,  G06F3/16

Abstract: Methods and systems are provided for warning a user of a head mounted display during gameplay of a video game. A game is executed causing interactive scenes of the game to be rendered on a display portion of a head mounted display (HMD) worn by a user. Images of a physical environment in a vicinity of the user are received from a forward facing camera of the HMD, while the game is being executed. The images are analyzed to determine if the user is approaching one or more objects in the physical environment. Data is sent to be rendered on the display portion of the HMD while rendering the interactive scenes of the game. The data provides information to avoid interaction with the one or more objects in the physical environment.

公开(公告)号：US20180011545A1

公开(公告)日：2018-01-11

申请号：US15694511

申请日：2017-09-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Todd Tokubo

IPC: G06F3/01

CPC classification number: G06F3/017 ,  A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/5255 ,  A63F2300/1012 ,  A63F2300/1031 ,  A63F2300/1087 ,  A63F2300/1093 ,  A63F2300/301 ,  A63F2300/303 ,  A63F2300/308 ,  A63F2300/538 ,  G06F3/011 ,  G06F3/014 ,  G06F3/0304 ,  G06K9/00382

Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.

公开(公告)号：US20170358141A1

公开(公告)日：2017-12-14

申请号：US15619395

申请日：2017-06-09

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Michael Taylor

IPC: G06T19/00 ,  G06F3/0482 ,  A63F13/537 ,  G06T7/246 ,  H04N5/232 ,  G06T11/60 ,  G06T17/05 ,  G06F3/01

CPC classification number: G06T19/006 ,  A63F13/537 ,  A63F2300/6081 ,  A63F2300/66 ,  A63F2300/8082 ,  G02B27/017 ,  G02B2027/0118 ,  G02B2027/0127 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/013 ,  G06F3/0482 ,  G06F3/04842 ,  G06F2203/04806 ,  G06T7/246 ,  G06T11/60 ,  G06T17/05 ,  H04N5/23296

Abstract: Methods and systems for presenting an object on to a screen of a head mounted display (HMD) include receiving an image of a real-world environment in proximity of a user wearing the HMD. The image is received from one or more forward facing cameras of the HMD and processed for rendering on a screen of the HMD by a processor within the HMD. A gaze direction of the user wearing the HMD, is detected using one or more gaze detecting cameras of the HMD that are directed toward one or each eye of the user. Images captured by the forward facing cameras are analyzed to identify an object captured in the real-world environment that is in line with the gaze direction of the user, wherein the image of the object is rendered at a first virtual distance that causes the object to appear out-of-focus when presented to the user. A signal is generated to adjust a zoom factor for lens of the one or more forward facing cameras so as to cause the object to be brought into focus. The adjustment of the zoom factor causes the image of the object to be presented on the screen of the HMD at a second virtual distance that allows the object to be discernible by the user.

公开(公告)号：US09753549B2

公开(公告)日：2017-09-05

申请号：US15472786

申请日：2017-03-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Todd Tokubo

IPC: G06F3/01

CPC classification number: G06F3/017 ,  A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/5255 ,  A63F2300/1012 ,  A63F2300/1031 ,  A63F2300/1087 ,  A63F2300/1093 ,  A63F2300/301 ,  A63F2300/303 ,  A63F2300/308 ,  A63F2300/538 ,  G06F3/011 ,  G06F3/014 ,  G06F3/0304 ,  G06K9/00382

Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.

公开(公告)号：US20170197142A1

公开(公告)日：2017-07-13

申请号：US15472786

申请日：2017-03-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Todd Tokubo

IPC: A63F13/213 ,  G06F3/01 ,  A63F13/5255 ,  G06K9/00 ,  A63F13/211 ,  A63F13/212

CPC classification number: G06F3/017 ,  A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/5255 ,  A63F2300/1012 ,  A63F2300/1031 ,  A63F2300/1087 ,  A63F2300/1093 ,  A63F2300/301 ,  A63F2300/303 ,  A63F2300/308 ,  A63F2300/538 ,  G06F3/011 ,  G06F3/014 ,  G06F3/0304 ,  G06K9/00382

Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.

公开(公告)号：US20250037621A1

公开(公告)日：2025-01-30

申请号：US18360736

申请日：2023-07-27

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Todd Tokubo

IPC: G09G3/00 ,  G02B27/01 ,  G02C5/02 ,  G06F3/01

Abstract: A wearable device is described. The wearable device includes a first display portion and a second display portion. The first display portion is located in front of eyes of a user to provide a high-resolution view of a virtual image of a virtual scene. The second display portion is located in front of the eyes of the user to provide a view of the user's nose. The second display portion can optionally occlude an area around the nose and optionally provide an effect of virtual lighting falling on the nose. The wearable device presents a view of the user's real nose as it would appear in a virtual scene.

公开(公告)号：US12189837B2

公开(公告)日：2025-01-07

申请号：US17731174

申请日：2022-04-27

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Todd Tokubo

IPC: G06F3/01 ,  G01B5/004 ,  G01C19/5783 ,  G01P13/00 ,  G06T7/70

Abstract: Systems and methods for determining movement of a hand-held controller (HHC) with respect to a head-mounted display (HMD) are described. A camera is located at a lower region of the HMD for capturing images of the HHC. The images of the HHC are used to determine a position and an orientation of the HHC with reference to the HMD. Also, the camera or another camera can be used to determine a position and orientation of the HMD with respect to a real-world environment. The position and orientation of the HMD and the position and orientation of the HHC are used to change to state of an application executed on a game cloud.