A video processing apparatus tracks an object in a video and performs detection processing for detecting that an object in the video is a specific object such that a number of times the detection processing is performed within a predetermined period on a tracking object not detected to be the specific object is more than a number of times the detection processing is performed within the predetermined period on a tracking object detected to be the specific object.