A first restoration processing section 110 and a second restoration processing section 120 perform restoration processing on images (luminance data Y), which are successively captured by an image capture section, using a first filter 102, which is a restoration filter generated corresponding to a point spread function of an optical system, and a second filter 104 of which a restoration strength is weaker than that of the first filter 102. Depending on a result of determination which is input from an in-focus determination section 150 and indicates whether or not the image at the current time point is in a target in-focus state, a selection section 122 selects and outputs either luminance data YA which is processed using the first filter 102 or luminance data YB which is processed using the second filter 104.