Invention Grant
- Patent Title: Method and device for neural architecture search optimized for binary neural network
-
Application No.: US17105988Application Date: 2020-11-27
-
Publication No.: US11132600B2Publication Date: 2021-09-28
- Inventor: Kunal Pratap Singh , Da Hyun Kim , Jong Hyun Choi
- Applicant: GIST(Gwangju Institute of Science and Technology)
- Applicant Address: KR Gwangju
- Assignee: GIST(Gwangju Institute of Science and Technology)
- Current Assignee: GIST(Gwangju Institute of Science and Technology)
- Current Assignee Address: KR Gwangju
- Agency: Studebaker & Brackett PC
- Priority: KR10-2020-0021738 20200221
- Main IPC: G06N3/063
- IPC: G06N3/063 ; G06N7/00 ; G06N3/04 ; G06N3/08

Abstract:
A method for generating a target network by performing neural architecture search using optimized search space is provided. The method includes steps of: a computing device (a) if a target data is inputted into the target network, allowing the target network to apply neural network operation to the target data, to generate an estimated search vector; and (b) allowing a loss layer to calculate architecture parameter losses by referring to the estimated search vector and a ground truth search vector, and to perform backpropagation by referring to the architecture parameter losses to update architecture parameter vectors for determining final layer operations among candidate layer operations included in an optimized layer type set corresponding to the optimized search space and wherein the final layer operations are to be performed by neural blocks, within cells of the target network, arranged according to an optimized cell template corresponding to the optimized search space.
Public/Granted literature
- US20210264240A1 METHOD AND DEVICE FOR NEURAL ARCHITECTURE SEARCH OPTIMIZED FOR BINARY NEURAL NETWORK Public/Granted day:2021-08-26
Information query