A method and system for estimating the three dimensional position of an object in a three dimensional physical space. Specifically, the method discloses capturing a plurality of images of a human form within the three dimensional (3D) physical space. Each of the plurality of images is captured from a different viewpoint location of the human form. At least one image capturing device calibrated within the 3D physical space is used to capture the images. A plurality of silhouettes of the human form is extracted from the plurality of images. A plurality of contours of an object of the human form is obtained from the plurality of silhouettes. A location of the object within the 3D physical space is determined from an object model of the object based on the plurality of contours.