Base station antennas are provided herein. A base station antenna includes consecutive vertical columns of radiating elements. The base station antenna includes a phase shifter that is electrically connected to one of the vertical columns of radiating elements. Moreover, the base station antenna includes a phase-error compensation component that is configured to provide phase-error compensation at an input to the phase shifter based on movement of the phase-error compensation component. Related methods of operation are also provided.