Various embodiments include methods, devices, and robotic vehicles that adjust a proximity threshold implemented in a collision avoidance system based on whether a payload is being carried. Methods may include determining whether a payload is carried by the robotic vehicle, setting a proximity threshold for collision avoidance in response to determining that a payload is carried by the robotic vehicle, and controlling one or more motors of the robotic vehicle using the proximity threshold for collision avoidance. Some embodiments may include raising the proximity threshold when a payload is not being carried or decreasing proximity threshold when a payload is being carried. Some embodiments may include determining a classification of a payload and setting the proximity threshold based at least in part on the classification.