Methods, systems, and apparatus, including computer programs encoded on computer storage media, for determining that current data captured at a current location of a drone satisfies localization adjustment criteria; in response to determining that the current data captured at the current location of the drone satisfies the localization adjustment criteria, identifying previously captured image data; determining a previous expected location of the drone based on both an expected change in location of the drone and a first previous location determined from other image data captured before the previously captured image data; determining a location difference between the previous expected location of the drone and a second previous location determined from the previously captured image data; and determining the current location of the drone based on the location difference.