Techniques related to contract detection autofocus for imaging devices and, in particular, to contrast detection autofocus using multiple filters to generate adaptive step sizes are discussed. Such techniques may include determining a ratio of filter responses for filters applied to a portion of a scene, generating a distance from focus based on the ratio, and determining a lens position movement based on an adaptive step size generated using the distance from focus and a confidence level associated with the distance from focus.