An amplifier gain setting section estimates a light source parameter which relies upon a spectral distribution of an image pickup light source based on an image signal. Then, a first adjustment control value for each color signal when adjustment is to be performed so as to establish a white balance based on the estimated parameter is modulated by an amount corresponding to a follow-up sensitivity toward a second adjustment control value when adjustment is to be performed so that an achromatic subject under a particular reference light source is reproduced as an achromatic subject. The modulated adjustment control value is set to a white balance amplifier. The follow-up sensitivity is set to the amplifier gain setting section in response to an illuminance level estimated from a detection value of the brightness.