Techniques are provided for adaptive selection of feature keypoints of an image. An example system may include a contrast statistics calculation circuit configured to generate contrast measurements of regions of the image associated with each of the feature keypoints, and to calculate a mean and variance of the contrast measurements. The system may also include an edge statistics calculation circuit configured to generate ratios of principal curvatures of regions of the image associated with each of the feature keypoints, and to calculate a mean and variance of the ratios of principal curvatures. The system may further include a threshold calculation circuit configured to calculate thresholds based on the mean and variance of the contrast measurements and on the mean and variance of the ratios of principal curvatures; and a keypoint filter circuit configured to filter the set of feature keypoints based on the those thresholds.