An image processing apparatus includes a first noise removal unit which removes noise from a pixel signal when a level of the signal falls outside a range defined by first and second threshold levels, a cyclic calculation unit which makes a cyclic calculation based on weighted averaging between signals on an identical column with respect to the signal in which the noise is removed by the first noise removal unit, a column offset detection unit which detects a column offset component for each column based on the calculation result, and a second noise removal unit which performs a noise removal operation with respect to a signal on the identical column using the previously calculated cyclic calculation result when a difference between the previously calculated cyclic calculation value and the current pixel signal value falls outside a range defined by third and fourth threshold levels.