An image recognizing apparatus includes a processor that controls first and second learning processes, the first learning process in second layers including holding, based on a large/small relation between neuron data size and parameter size of the second layer, in a memory area, an error gradient of parameters to be sent to the corresponding layer of the second layers; and the second learning process between first layers including holding, in a memory area of each first layers, an error gradient of parameters to be sent to the corresponding layer of the first layers, which is computed based on the error gradient or an error gradient of a previous layer of the first layers, based on a large/small relation between neuron data size and parameter size of the first layer.