A target position setting device includes a distance meter, an imager, first and second calculating portions, a determination portion, and a setting portion. The distance meter measures a distance to an object around a vehicle. The imager takes an image of an environment around the vehicle. The first calculating portion calculates a first candidate of a target position of the vehicle according to a measuring result of the distance meter. The second calculating portion calculates a second candidate of the target position of the vehicle according to an imaging result of the imager. The determination portion determines whether a relationship between the first candidate and the second candidate meets a given condition. The setting portion sets the target position according to the second candidate of the target position when the determination portion determines that the relationship between the first candidate and the second candidate meets the given condition.