A method for optimizing the position and size of a search window in a tracking system is disclosed. According to some embodiments of the present invention, the method may comprise: calculating a velocity of a tracked object based on comparison of at least two previously captured consecutive frames; calculating an expected position of the tracked object in a subsequent frame based on calculated velocity of the tracked object; determine possible positions of the tracked object in the subsequent frame, based on the last known position of the tracked object, status of the tracked object, the expected position and the acceleration of the tracked object; and optimizing the size and position of the search window within the subsequent frame so that the search window covers the expected position and at least one of the possible positions of said tracked object.