A system and method for computer vision based tracking of a human form may include receiving a sequence of images, the images including at least one object having a shape of a human form. A first selected feature is tracked from within the human form shaped object. Shape recognition algorithms are applied at a suspected location of the human form shaped object in an image from the sequence of images to detect a shape of a human form in the image and a second feature from within the detected shape of the human form is then selected and tracked, thereby providing verification and updating of the location of the human form shaped object.