The subject disclosure relates to ways to resolve autonomous vehicle (AV) routes based on verbal descriptions of landmark features. In some aspects, a process of the disclosed technology includes steps for receiving speech instructions, wherein the speech instructions indicate an autonomous vehicle (AV) destination, analyzing the speech instructions to identify one or more landmarks associated with the AV destination, and determining location information corresponding with the one or more landmarks. In some aspects, the process further includes calculating a route based on the location information corresponding with the one or more landmarks. Systems and machine-readable media are also provided.