A geo-registration system with a camera receives an image of a scene, identifies features in the image, and computes vectors for each feature based on the known location and orientation of the camera. The system then compares the computed vectors to vectors associated with the same features identified in prior images. The geo-registration system then uses stochastic kriging techniques to create a geo-registration model based on the vectors.