A three-dimensional (3D) pose of a 3D object in an environment is determined by extracting features from an image acquired of the environment by a camera. The features are matched to a 3D model of the environment to determine correspondences. A camera reference frame of the image and a world reference frame of the environment are transformed to a corresponding intermediate camera reference frame and a corresponding world reference frame using the correspondences. Geometrical constraints are applied to the intermediate camera reference frame and the intermediate world reference frame to obtain a constrained intermediate world reference frame and a constrained world reference frame. The 3D pose is then determined from parameters of the constrained intermediate world reference frame and the constrained world reference frame.