A method of controlling an autonomous vehicle with a vision-based navigation and guidance system. The method includes capturing image frames at a predetermined frame rate. Detecting image points that define an edge in each image frame. Using image points in each image frame to locate a determined edge. Dynamically predicting the location of image points that define an edge in a subsequent image frame. Using the prediction of the location of image points that define an edge to narrow the search area for the edge in the subsequent image frame. Determining offset distances between determined edges in sequential image frames and controlling the vehicle based at least in part on determined offset distances between determined edges in sequential image frames.