公开(公告)号：US20220409991A1

公开(公告)日：2022-12-29

申请号：US17768278

申请日：2019-10-16

Applicant: Sony Interactive Entertainment Inc. ,  Sony Group Corporation

Inventor： Yoshinori Ohashi ,  Keita Mochizuki ,  Yasutaka Fukumoto

IPC: A63F13/212 ,  G06T7/20 ,  G06T7/70 ,  A63F13/211

Abstract: Methods and apparatus provide for acquiring, from a plurality of sensors attached to a plurality of body parts of a target person, at least information regarding movement acceleration and posture angular velocity of each of body parts to which the sensors are attached, and estimating, on the basis of the acquired information regarding the movement acceleration and posture angular velocity, the movement velocity in a predetermined coordinate system of each of the body parts to which the sensors are attached. Subsequently, on the basis of the information regarding the estimated movement velocity of each of the body parts, the methods and apparatus provide for estimating the positions of predetermined body parts of the target person.

公开(公告)号：US20220319105A1

公开(公告)日：2022-10-06

申请号：US17596043

申请日：2020-07-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Yoshinori Ohashi ,  Kazuyuki Arimatsu

IPC: G06T15/20 ,  G06T15/04 ,  G06T5/00 ,  G06T15/00 ,  G06F3/01 ,  A63F13/52

Abstract: A reprojection unit executes reprojection processing for converting an image including depth value information to align with a viewpoint position or a line of sight direction according to a plurality of different depth values, and generates a composite image by compositing a plurality of images subjected to the reprojection processing according to the plurality of different depth values. A distortion processing unit executes distortion processing for transforming the composite image in alignment with distortion arising in a display optical system.

公开(公告)号：US11373379B2

公开(公告)日：2022-06-28

申请号：US17268857

申请日：2018-08-23

Applicant: Sony Interactive Entertainment Inc.

Inventor： Yoshinori Ohashi ,  Masaomi Nishidate ,  Norihiro Nagai

IPC: G06T19/00 ,  G06T7/70 ,  H04N13/279 ,  G06F3/01

Abstract: A contact determination section determines whether or not there is any contact between a body part of a user and an object in a real world. An AR region determination section determines, as an augmented reality region, a region that corresponds to a partial space including a portion of the object in the real world, the portion having been contacted by the body part, and that is viewed from a viewpoint of the user. An AR generation section generates an augmented reality image in the augmented reality region in a shot image of the real world.

公开(公告)号：US20220138982A1

公开(公告)日：2022-05-05

申请号：US17431476

申请日：2019-02-26

Applicant: Sony Interactive Entertainment Inc.

Inventor： Yoshinori Ohashi

IPC: G06T7/73 ,  G06V40/10 ,  G06T19/20 ,  G06T15/20

Abstract: An information processing apparatus that generates an image in a virtual space to be presented to a user detects information as to a position of a target object in a real space, places a virtual object corresponding to the target object at a position in the virtual space obtained on the basis of the detected information as to the position of the target object in the real space, acquires user body size data representing the size of a body of the user in the real space, and determines the position in the virtual space at which the virtual object is to be placed, using the detected information as to the position of the target object in the real space, and the user body size data about the user in the real space.

公开(公告)号：US20220136858A1

公开(公告)日：2022-05-05

申请号：US17431520

申请日：2019-03-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： Yoshinori Ohashi

IPC: G01C21/00

Abstract: Provided are an environment map management device, an environment map management system, an environment map management method, and a program that are capable of generating a common environment map that takes into consideration privacy of each of users simultaneously with securing a space covered by an environment map available to the each of users. A processing data transmitting section accesses an individual environment map available to a user of interest. The processing data transmitting section accesses a common environment map available to a plurality of users including the user of interest. A SLAM processing execution section adds, to the individual environment map, environment information generated on the basis of sensing data acquired by a tracker used by the user of interest. A transmitting control section controls whether or not to add the environment information to the common environment map, according to a privacy attribute corresponding to the environment information.

公开(公告)号：US20210295580A1

公开(公告)日：2021-09-23

申请号：US17278648

申请日：2019-06-21

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Yoshinori Ohashi

IPC: G06T13/40 ,  A63F13/212 ,  A63F13/25

Abstract: A skeleton model update apparatus, a skeleton model update method, and a program capable of improving adequacy of a determination result of a posture of a skeleton model by using Forward and Backward Reaching Inverse Kinematics computing is provided. A posture data acquisition section (52) acquires posture data indicating a posture of a target node included in a skeleton model of a tree structure. An initial position determination section (54) determines a position to which the target node is to move on the basis of the position data. The initial position determination section (54) determines an initial position of a parent node of the target node in Forward and Backward Reaching Inverse Kinematics computing on the basis of the position to which the target node is to move and a given posture of the skeleton model. A posture update section (56) updates a posture of the skeleton model by executing the Forward and Backward Reaching Inverse Kinematics computing including determination of a new position of the parent node on the basis of the position to which the target node is to move and the initial position of the parent node.

公开(公告)号：US11120632B2

公开(公告)日：2021-09-14

申请号：US16590957

申请日：2019-10-02

Applicant: Sony Interactive Entertainment Inc.

Inventor： Yoshinori Ohashi

IPC: G06T19/00 ,  G02B27/01 ,  H04N9/75

Abstract: An image generating apparatus includes a rendering unit carrying out rendering of an object of a virtual space and an object of a real space and carrying out rendering of expression relating to light of the virtual space with respect to the real space to generate a computer graphics image, a superimposing unit superimposing the computer graphics image on a photographed image of the real space to generate a provisional superposition image, a chroma key generating unit generating a chroma key image through executing chroma key processing for the computer graphics image based on depth information of the photographed image of the real space, and a synthesizing unit generating a synthesized chroma key image used for being superimposed on the photographed image of the real space to generate an augmented reality image by applying a mask to the provisional superposition image by the chroma key image.

公开(公告)号：US11100716B2

公开(公告)日：2021-08-24

申请号：US16652101

申请日：2018-10-05

Applicant: Sony Interactive Entertainment Inc.

Inventor： Yoshinori Ohashi

IPC: G06T19/00 ,  G06T15/20

Abstract: A rendering unit renders an object in a virtual space to generate a computer graphics image. An AR superimposing unit superimposes the computer graphics image on a captured image of a reality space to generate an augmented-reality image. A post-processing unit performs post-processing on the augmented-reality image. The AR superimposing unit superimposes, on the same computer graphics image, a plurality of captured images provided at a frame rate higher than the frame rate of the computer graphics image generated by the rendering unit, to generate the augmented-reality image.

公开(公告)号：US11077360B2

公开(公告)日：2021-08-03

申请号：US16605667

申请日：2018-04-18

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Yoshinori Ohashi

IPC: A63F13/213 ,  A63F13/25 ,  A63F13/52 ,  A63F13/533 ,  A63F13/577 ,  G06F3/01 ,  G06T19/00 ,  G09G5/36 ,  G06F3/0482 ,  G06F3/0484

Abstract: An information processing device obtains information regarding the position of each fingertip of a user in a real space, and determines contact between a virtual object set within a virtual space and a finger of the user. The information processing device sets the virtual object in a partly deformed state such that a part of the virtual object, the part corresponding to the position of the finger determined to be in contact with the object among the fingers of the user, is located more to a far side from a user side than the finger, and displays the virtual object having the shape set thereto as an image in the virtual space on a display device.

公开(公告)号：US11003408B2

公开(公告)日：2021-05-11

申请号：US16590551

申请日：2019-10-02

Applicant: Sony Interactive Entertainment Inc.

Inventor： Yoshinori Ohashi

IPC: G06F3/14 ,  G09G3/00 ,  G06T11/60 ,  G06F3/01

Abstract: An image generating apparatus includes: a rendering unit that carries out rendering of objects of a virtual space and generates a computer graphics image; a drawing processing unit that executes subsequent drawing processing for the computer graphics image; and an interrupt unit that interrupts the rendering at a timing of a graphics processor interrupt and causes execution of the subsequent drawing processing based on a result of the rendering to the timing of the graphics processor interrupt. The drawing processing unit includes a reprojection unit that executes reprojection processing of converting the computer graphics image in conformity to a new position of a point of view or a new direction of a line of sight as the subsequent drawing processing. The interrupt unit causes execution of the reprojection processing of the computer graphics image, based on the result of the rendering to the timing of the graphics processor interrupt.