When groups of coordinates of face areas respectively contained in mutually different frames are within a predetermined error range, a face attribute assigning unit assigns mutually the same face attribute value to each of the face areas. In the case where a difference in the feature amounts between the frames is within a predetermined error range, a similar shot detecting unit detects that the shots from which the frames have respectively been extracted are similar shots to each of which mutually the same shot attribute value is assigned. In the case where it is judged that face areas that respectively appear in the frames contained in the similar shots and to which mutually different face attribute values have respectively been assigned represent the face of mutually the same person, the face attribute re-assigning unit assigns mutually the same face attribute value to each of the face areas.