A system and method are provided for registering input images to reference objects to generate output parameters. The method includes obtaining an input image and a reference object, wherein the reference object comprises a reference image or a template corresponding to a model of content in the reference image. The method also includes performing a registration of the input image by estimating a geometric transform and/or a set of non-linear transform parameters, without using predefined image features. The method also includes measuring a misalignment error between the input images and the reference object and generating a set of output parameters. The output parameters can include a set of one or more camera parameters or a set of geometric and non-linear transformation parameters.