Two images are stitched together through minimization of a cost function that consists of registration errors from image data of the two images, as well as the estimated errors from a set of sensors. The weight function in the cost function is derived from the confidence value of sensor estimation that considers the sensor errors including lift and off page as well as a measure of accuracy of the sensor readings. Weights are used to adjust image registration accuracy against sensor accuracy to produce a set of registration parameters that would best stitch the two images together. In order to handle large errors for initial registration parameters and to avoid local minima in the minimization process, the image pair may be registered in a lower resolution and then refined in a higher resolution.