An image processing apparatus includes: a calculating unit that calculates an evaluation value, which is expressed as a sum of confidence degrees obtained by mixing, at a predetermined mixing ratio, a matching degree of a first feature quantity and a matching degree of a second feature quantity between a target image containing an object to be tracked and a comparison image which is an image of a comparison region compared to the target image of a first frame, when the mixing ratio is varied and obtaining the mixing ratio when the evaluation value is maximum; and a detecting unit that detects an image corresponding to the target image of a second frame based on the confidence degrees in which the mixing ratio is set when the evaluation value is the maximum.