公开(公告)号：US20150124052A1

公开(公告)日：2015-05-07

申请号：US14397540

申请日：2013-04-24

Applicant: Sony Corporation

Inventor： Katsuhisa Ito ,  Kengo Hayasaka ,  Masahiro Takada

IPC: H04N13/00 ,  H04N13/02

CPC classification number: H04N13/111 ,  H04N13/204 ,  H04N13/243 ,  H04N2013/0081

Abstract: An image processing apparatus comprising an interpolation processing unit configured to generate a plurality of interpolation images based on a plurality of viewpoint images. The image processing apparatus further comprises a development processing unit configured to develop a subject image based on a development parameter and a plurality of ray vectors associated with the plurality of interpolation images and the plurality of viewpoint images.

Abstract translation: 一种图像处理装置，包括：内插处理单元，被配置为基于多个视点图像生成多个内插图像。 图像处理装置还包括：显影处理单元，被配置为基于与多个插值图像和多个视点图像相关联的显影参数和多个光线矢量来显影被摄体图像。

公开(公告)号：US20140327809A1

公开(公告)日：2014-11-06

申请号：US14331862

申请日：2014-07-15

Applicant: SONY CORPORATION

Inventor： Kengo Hayasaka ,  Kenji Yamamoto

IPC: H04N5/232 ,  H04N5/225

CPC classification number: H04N5/232 ,  G02B27/0075 ,  H04N5/2254 ,  H04N5/23212

Abstract: An image pickup apparatus includes: an image pickup lens having an aperture stop; an image pickup device obtaining image pickup data based on light detected; one or more microlenses arranged between the image pickup lens and the image pickup device so as to correspond to a plurality of pixels in a partial region of the image pickup device; and an image processing section performing image processing based on the image pickup data obtained from the image pickup device, in which the image processing section includes: a distance measurement section measuring a distance from the image pickup lens to a measurement object based on pixel data in the partial region of the image pickup device, and an interpolation section interpolating pixel data for the partial region of the image pickup device.

Abstract translation: 图像拾取装置包括：具有孔径光阑的图像拾取透镜; 基于检测到的光获取图像拾取数据的图像拾取装置; 布置在图像拾取透镜和图像拾取装置之间的一个或多个微透镜，以便对应于图像拾取装置的部分区域中的多个像素; 以及图像处理部，其基于从所述图像拾取装置获得的图像拾取数据进行图像处理，所述图像处理部包括：距离测量部，其基于所述图像拾取装置中的像素数据测量从所述图像拾取透镜到所述测量对象的距离 图像拾取装置的部分区域，以及用于内插图像拾取装置的部分区域的像素数据的插值部分。

公开(公告)号：US10748264B2

公开(公告)日：2020-08-18

申请号：US15751063

申请日：2016-08-26

Applicant: SONY CORPORATION

Inventor： Katsuhisa Ito ,  Makibi Nakamura ,  Kengo Hayasaka

IPC: G06K9/34 ,  G06T5/50 ,  G06T5/00 ,  H04N5/222 ,  H04N13/271 ,  H04N5/225 ,  G06T7/557 ,  H04N13/254 ,  H04N13/128 ,  H04N13/122 ,  G06T7/593 ,  H04N13/106 ,  G06K9/00 ,  G06K9/32 ,  H04N5/232

Abstract: The present technique relates to an image processing apparatus and an image processing method capable of obtaining an obstacle-removed image in which an obstacle does not appear using disparity information. A removal section generates after-removal photographic images at a plurality of viewpoints by removing part of subjects from respective photographic images at the plurality of viewpoints using disparity information associated with the photographic images at the plurality of viewpoints. An image generation section generates an obstacle-removed image at a predetermined viewpoint by registering the after-removal photographic images at the plurality of viewpoints using the disparity information. The present technique is applicable to a case, for example, of generating an obstacle-removed image in which an obstacle does not appear using photographic images at a plurality of viewpoints.

公开(公告)号：US10547822B2

公开(公告)日：2020-01-28

申请号：US15123090

申请日：2015-05-08

Applicant: SONY CORPORATION

Inventor： Kengo Hayasaka ,  Katsuhisa Ito

IPC: H04N13/111 ,  H04N13/243 ,  G06T3/40

Abstract: The present disclosure relates to an image processing apparatus and a method capable of generating high-definition viewpoint interpolation images at high speed. A space reconstruction unit reconstructs a space in which viewpoint images are photographed according to each viewpoint image and each disparity (pixel shift amount) map and supplying reconstruction data of the space to an interpolation position setting unit. The interpolation position setting unit sets an interpolation position in the reconstructed space while changing (an inclination of) a beam and supplies interpolation target coordinates indicating the set interpolation position to a data search unit. The data search unit generates an interpolation image at any viewpoint by sampling RGB values at interpolation target coordinates supplied from the interpolation position setting unit and outputs the generated interpolation image to a subsequent stage. The present disclosure is applicable to, for example, an image processing apparatus that performs image processing using multi-view images.

公开(公告)号：US10134136B2

公开(公告)日：2018-11-20

申请号：US14427403

申请日：2013-08-22

Applicant: SONY CORPORATION

Inventor： Kengo Hayasaka ,  Katsuhisa Ito

IPC: G06K9/00 ,  G06T7/00 ,  G01C3/14 ,  G01S11/12 ,  G01C3/06 ,  G06T5/00 ,  G06T7/60 ,  G06T7/593 ,  H04N13/00

Abstract: According to an embodiment of the present technology, there is provided an image processing apparatus including a parallax information generation unit. The parallax information generation unit generates parallax information based on a first phase difference distribution and a second phase difference distribution, the first phase difference distribution being generated on a pixel by pixel basis for the first parallax image and the second parallax image, the second phase difference distribution being generated on a sub-pixel by sub-pixel basis based on the first phase difference distribution.

公开(公告)号：US10043290B2

公开(公告)日：2018-08-07

申请号：US15430702

申请日：2017-02-13

Applicant: SONY CORPORATION

Inventor： Kengo Hayasaka

IPC: G06K9/00 ,  G06T7/00 ,  G06T7/70 ,  H04N5/247 ,  G01B11/14 ,  H04N13/02

Abstract: There is provided an image processing apparatus including a distance information generation portion configured to generate first distance information about an object to be measured based on a phase difference between images provided by a plurality of first cameras having a first base length, and generate second distance information about the object to be measured based on a phase difference between images provided by a plurality of second cameras having a second base length that is different from the first base length; and a distance extraction portion configured to extract distance information from an imaging position and the object to be measured based on the first distance information and the second distance information.

公开(公告)号：US09749519B2

公开(公告)日：2017-08-29

申请号：US14889283

申请日：2014-05-02

Applicant: SONY CORPORATION

Inventor： Katsuhisa Ito ,  Atsushi Miyamoto ,  Kengo Hayasaka ,  Hironori Mori

IPC: H04N5/232 ,  G06F3/0484 ,  G06F3/0481 ,  G06F3/0486 ,  G06F3/0488

CPC classification number: H04N5/23216 ,  G06F3/04817 ,  G06F3/04845 ,  G06F3/04847 ,  G06F3/0486 ,  G06F3/0488 ,  H04N5/23212 ,  H04N5/23293 ,  H04N13/271 ,  H04N13/282

Abstract: There is provided an image processing apparatus including a display configured to display a captured image and a representative icon, wherein the representative icon indicates a range of a focus area of the displayed image and the range encompasses a center of focus point located at an initial position within the displayed image, and a processor configured to adjust the range of the focus area of the displayed image according to a size of the representative icon.

公开(公告)号：US09164626B2

公开(公告)日：2015-10-20

申请号：US14162007

申请日：2014-01-23

Applicant: Sony Corporation

Inventor： Kengo Hayasaka ,  Kenji Yamamoto

IPC: G06F3/042 ,  G06F3/041

CPC classification number: G06F3/0425 ,  G06F3/0412 ,  G06F3/042 ,  G06F2203/04101

Abstract: An input/output device capable of displaying a high-resolution two-dimensional image and detecting the position of an object in three-dimensional space in spite of having a low profile is provided. An input/output device includes: a display section including, in a mixed manner, image pickup regions for obtaining image pickup data of an object and a display region for displaying an image based on image data; a microlens arranged on a display surface of the display section so as to correspond to each of the image pickup regions; and a position detection section detecting position of the object based on image pickup data obtained from the image pickup regions of the display section.

Abstract translation: 提供了能够显示高分辨率二维图像并且尽管具有低轮廓来检测三维空间中的对象的位置的输入/输出装置。 输入/输出装置包括：显示部分，以混合的方式包括用于获得对象的图像拾取数据的图像拾取区域和用于基于图像数据显示图像的显示区域; 微透镜，布置在显示部分的显示表面上，以对应于每个摄像区域; 以及位置检测部，其基于从所述显示部的图像拾取区域获得的图像拾取数据来检测所述对象的位置。

公开(公告)号：US20140160079A1

公开(公告)日：2014-06-12

申请号：US14162007

申请日：2014-01-23

Applicant: Sony Corporation

Inventor： Kengo Hayasaka ,  Kenji Yamamoto

IPC: G06F3/042

CPC classification number: G06F3/0425 ,  G06F3/0412 ,  G06F3/042 ,  G06F2203/04101

Abstract: An input/output device capable of displaying a high-resolution two-dimensional image and detecting the position of an object in three-dimensional space in spite of having a low profile is provided. An input/output device includes: a display section including, in a mixed manner, image pickup regions for obtaining image pickup data of an object and a display region for displaying an image based on image data; a microlens arranged on a display surface of the display section so as to correspond to each of the image pickup regions; and a position detection section detecting position of the object based on image pickup data obtained from the image pickup regions of the display section.

Abstract translation: 提供了能够显示高分辨率二维图像并且尽管具有低轮廓来检测三维空间中的对象的位置的输入/输出装置。 输入/输出装置包括：显示部分，以混合的方式包括用于获得对象的图像拾取数据的图像拾取区域和用于基于图像数据显示图像的显示区域; 微透镜，布置在显示部分的显示表面上，以对应于每个摄像区域; 以及位置检测部，其基于从所述显示部的图像拾取区域获得的图像拾取数据来检测所述对象的位置。