Aspects of the disclosure provide for enabling autonomous vehicles to pull over into driveways when picking up or dropping off passengers or goods. For instance, a request for a trip identifying a first location and a second location may be received. The first location may be a location of a client computing device, and the second location may be a starting location or a destination for the trip. A user preference for the trip indicating that a pickup for the trip be in a driveway may be identified. That the first location corresponds with the second location may be identified. Based on the determination that the first location corresponds with the second location, dispatch instructions may be to an autonomous vehicle. The dispatch instructions may identify a polygon for a driveway at the second location in order to cause the autonomous vehicle to pull over into the driveway.