An accessory mounting system for a work vehicle includes a first mount extending from a lateral side of a body of the work vehicle, in which the first mount is configured to couple to a first end of a rotatable component to rotatably couple the rotatable component to the body of the work vehicle. Further, the accessory mounting system for includes a cover assembly having a cover, in which the cover assembly is coupled to the lateral side of the body of the work vehicle, and at least a portion of the cover is positioned laterally outward from the first mount such that the first end of the rotatable component is disposed between the lateral side of the body of the work vehicle and the portion of the cover while the first end of the rotatable component is coupled to the first mount.