An image processing apparatus includes an obtaining unit configured to obtain a moving image, a detection unit configured to detect a detection target object from an interest image frame in the moving image, a tracking unit configured to obtain a tracked object in a neighborhood region of a detection position of the detection target object in an image frame preceding the interest image frame in the moving image, and a determination unit configured to determine whether or not the tracked object corresponds to the detection target object by integrating a position where the detection target object is detected by the detection unit and a position where the tracked object is obtained by the tracking unit.