An image processing apparatus comprising, a tracking unit configured to detect an object and track the object in images to be processed, the images being sequential with respect to time, a determining unit configured to determine a stay time for which the object stays, on the basis of a result of the tracking, and an associating unit configured to specify, on the basis of the result of the tracking, one predetermined location from one or more predetermined locations included in the images to be processed, and associate the specified one predetermined location with the stay time.