公开(公告)号：GB2581728A

公开(公告)日：2020-08-26

申请号：GB202006969

申请日：2018-10-04

Applicant: IBM

Inventor： ZHUO WANG ,  JUNGWOOK CHOI ,  KAILASH GOPALAKRISHNAN ,  SWAGATH VENKATARAMANI ,  CHARBEL SAKR

IPC: G06N3/08

Abstract: Techniques that facilitate improving an efficiency of a neural network are described. In one embodiment, a system is provided that comprises a memory that stores computer-executable components and a processor that executes computer-executable components stored in the memory. In one implementation, the computer-executable components comprise an initialization component that selects an initial value of an output limit, wherein the output limit indicates a range for an output of an activation function of a neural network. The computer-executable components further comprise a training component that modifies the initial value of the output limit during training to a second value of the output limit, the second value of the output limit being provided as a parameter to the activation function. The computer-executable components further comprise an activation function component that determines the output of the activation function based on the second value of the output limit as the parameter.