-
公开(公告)号:US20190273856A1
公开(公告)日:2019-09-05
申请号:US16340604
申请日:2017-10-26
Applicant: SONY CORPORATION
Inventor: YASUTAKA HIRASAWA , YUHI KONDO , HIDEKI OYAIZU , SHUN KAIZU , TEPPEI KURITA , TUO ZHUANG , YING LU , HAJIME MIHARA
Abstract: An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided. The image processing device includes: an image input unit that acquires at least three types of images formed with polarization images of different polarizing directions or non-polarization images; an angle input unit that outputs reflection angles that are the angles between the image capturing directions of the acquired images and the plane direction corresponding to the normal direction of the reflecting surface, to an intensity transmittance and intensity reflectance calculation unit; a calculation unit that calculates the respective intensity transmittances and the respective intensity reflectances of S waves and P waves, using the reflection angles; and a reflection component separation unit that removes the reflected light component from the images acquired by the image input unit, using the respective intensity transmittances and the respective intensity reflectances of the S waves and P waves. These processes enable removal of reflected light components from captured images having various reflection angles.
-
公开(公告)号:US20210235060A1
公开(公告)日:2021-07-29
申请号:US17055790
申请日:2019-02-18
Applicant: SONY CORPORATION
Inventor: YASUTAKA HIRASAWA , YING LU
IPC: H04N13/218 , H04N13/246 , H04N5/369 , H04N13/254 , H01L27/146
Abstract: A polarization imaging unit 20 has a configuration in which each pixel group including a plurality of pixels is provided with a microlens and the pixel group includes at least three polarization pixels having different polarization directions, and the pixels included in the pixel group perform photoelectric conversion of light that is incident via the microlenses to acquire a polarization image. A polarization state calculation unit 31 of an information processing unit 30 accurately acquires a polarization state of an object by using a polarization image of the object acquired using the polarization imaging unit 20 and a main lens 15, and a correction parameter stored in advance in a correction parameter storage unit 32 and set for each microlens in accordance with the main lens.
-
3.
公开(公告)号:US20210152748A1
公开(公告)日:2021-05-20
申请号:US17044533
申请日:2019-01-15
Applicant: SONY CORPORATION
Inventor: YING LU , YASUTAKA HIRASAWA , YUHI KONDO , TUO ZHUANG , LEGONG SUN
Abstract: A polarization imaging unit 20 acquires a polarization image using a lens. In a parameter storage unit 32 of an information processing unit 30, parameters related to a change in polarization state due to the lens which are estimated in advance from polarization state information acquired by imaging a light source in a predetermined polarization state using the lens and polarization state information indicating the polarization state of the light source, for example, change parameters indicating the change in polarization state due to the lens or correction parameters for correcting the change in polarization state due to the lens are stored. A polarization state correction unit 33 of the information processing unit 30 corrects the change in polarization state due to the lens, using the parameters stored in advance in the parameter storage unit 32.
-
公开(公告)号:US20210374906A1
公开(公告)日:2021-12-02
申请号:US17056550
申请日:2019-02-18
Applicant: Masayoshi Doshida , SONY CORPORATION
Inventor: LEGONG SUN , YASUTAKA HIRASAWA , YUHI KONDO , YING LU , TUO ZHUANG
Abstract: A normal candidate information generation unit 31 of an information processor 30 generates normal candidate information for each pixel indicating, for example, a zenith angle, or an azimuth angle, or a zenith angle and an azimuth angle, on the basis of a polarization image in a plurality of polarization directions obtained by a polarization imaging unit 20. The in-plane pixel selection unit 32 selects a plurality of pixels indicating the plane to be observed in the polarization image. A normal calculation unit 33 calculates a normal of the plane to be observed on the basis of the normal candidate information of the pixels selected by the in-plane pixel selection unit 32. For example, the normal calculation unit 33 calculates the normal of the plane to be observed on the basis of a line-of-sight axis indicating a light beam direction from the plane to be observed corresponding to the pixels selected by the in-plane pixel selection unit 32 toward the polarization imaging unit 20 and the zenith angles of the selected pixels.
-
公开(公告)号:US20180107108A1
公开(公告)日:2018-04-19
申请号:US15565968
申请日:2016-03-01
Applicant: SONY CORPORATION
Inventor: AYAKA NAKATANI , YASUTAKA HIRASAWA , YUHI KONDO , YING LU
CPC classification number: G03B35/26 , G01B11/00 , G01B11/005 , G01B11/168 , G01B11/26 , G03B35/04 , G03B35/06 , G06F3/01 , G06K9/00375 , G06K9/2036 , G06K9/209 , G06T7/00 , H04N5/2254
Abstract: A polarized image acquisition section 20 acquires a plurality of polarized images having different polarization directions. The polarized images show, for example, an input indicator for a user interface as a recognition target object. A normal line calculation section 30 calculates normal lines for individual pixels of the recognition target object in accordance with the polarized images acquired by the polarized image acquisition section 20. The normal lines represent information based on the three-dimensional shape of the recognition target object. A recognition section 40 recognizes the object by using the normal lines calculated by the normal line calculation section 30, determines, for example, the type, position, and posture of the input indicator, and outputs the result of determination as input information on the user interface. The object can be recognized easily and with high accuracy.
-
6.
公开(公告)号:US20200350353A1
公开(公告)日:2020-11-05
申请号:US16763543
申请日:2018-09-18
Applicant: SONY CORPORATION
Inventor: TEPPEI KURITA , YING LU , YUHI KONDO , YASUTAKA HIRASAWA
IPC: H01L27/146 , H04N5/369
Abstract: An unpolarized component image generating section 32-1 generates unpolarized component image signals of specific and non-specific colors. A polarized component image generating section 33-1 generates polarized component image signals of the specific and non-specific colors. A specific color polarization property detecting section 34-1 detects polarization properties of the specific color using pixel signals of polarized or unpolarized pixels of the specific color having at least three polarization directions and pixel signals of polarized pixels having two polarization directions. An unpolarized color polarization property detecting section 35 detects polarization properties of the non-specific color on the basis of the polarization properties of the specific color detected by the specific color polarization property detecting section 34-1, the pixel signals of the unpolarized pixels of the non-specific color, and the pixel signals of the polarized pixels of the non-specific color having fewer polarization directions than the polarized pixels of the specific color. The polarization properties are thus detected for each color without recourse to the assumption that the degree of polarization is the same for each color.
-
公开(公告)号:US20180122086A1
公开(公告)日:2018-05-03
申请号:US15569259
申请日:2016-03-01
Applicant: SONY CORPORATION
Inventor: YING LU , YASUTAKA HIRASAWA , YUHI KONDO , AYAKA NAKATANI , AKIHIKO KAINO
CPC classification number: G06T7/246 , G06T7/20 , G06T7/579 , G06T7/73 , G06T2207/10028 , G06T2207/30244
Abstract: A normal-line information generation block 30 generates normal-line information for a frame subject to detection. A data storage block 50 stores normal-line information and the like of a key frame. A motion amount detection block 40 detects a motion amount of an imaging position of the frame subject to detection relative to an imaging position of the key frame on the basis of the normal-line information of the key frame stored in the data storage block 50 and the normal-line information of the frame subject to detection generated by the normal-line information generation block 30. Even if a positional difference of a same point is small or a luminance difference occurs between a taken image of the key frame and a taken image of a current frame, a motion amount of the imaging position of the frame subject to detection relative to the imaging position of the key frame can be accurately detected on the basis of normal-line information. Therefore, an observation position can be accurately detected.
-
-
-
-
-
-