- Patent Title: Method for automatically evaluating labeling reliability of training images for use in deep learning network to analyze images, and reliability-evaluating device using the same
-
Application No.: US16264027Application Date: 2019-01-31
-
Publication No.: US10579907B1Publication Date: 2020-03-03
- Inventor: Kye-Hyeon Kim , Yongjoong Kim , Insu Kim , Hak-Kyoung Kim , Woonhyun Nam , SukHoon Boo , Myungchul Sung , Donghun Yeo , Wooju Ryu , Taewoong Jang , Kyungjoong Jeong , Hongmo Je , Hojin Cho
- Applicant: Stradvision, Inc.
- Applicant Address: KR Pohang
- Assignee: STRADVISION, INC.
- Current Assignee: STRADVISION, INC.
- Current Assignee Address: KR Pohang
- Agency: Xsensus LLP
- Main IPC: G06K9/62
- IPC: G06K9/62 ; G06N3/04 ; G06N3/08 ; G06K9/46 ; G06F17/18

Abstract:
A method for evaluating a reliability of labeling training images to be used for learning a deep learning network is provided. The method includes steps of: a reliability-evaluating device instructing a similar-image selection network to select validation image candidates with their own true labels having shooting environments similar to those of acquired original images, which are unlabeled images, and instructing an auto-labeling network to auto-label the validation image candidates with their own true labels and the original images; and (i) evaluating a reliability of the auto-labeling network by referring to true labels and auto labels of easy-validation images, and (ii) evaluating a reliability of a manual-labeling device by referring to true labels and manual labels of difficult-validation images. This method can be used to recognize surroundings by applying a bag-of-words model, to optimize sampling processes for selecting a valid image among similar images, and to reduce annotation costs.
Public/Granted literature
- US1757007A Machine for purifying cereal products or removing branny material therefrom Public/Granted day:1930-05-06
Information query