An obstacle detection system for a work vehicle includes a controller having a memory and a processor. The controller is configured to receive a first signal indicative of a position of an obstacle relative to the work vehicle, to determine whether the position of the obstacle corresponds to a position of a movable object coupled to the work vehicle, and to output a second signal indicative of detection of the obstacle in response to determining that the position of the obstacle does not correspond to the position of the movable object.