A method for automatically controlling vehicle speeds of a track-based work vehicle may include monitoring, with a computing device, a load transmitted through a pivot pin of a track assembly of the work vehicle and determining, with the computing device, a speed limit setting for the work vehicle based on the monitored load, wherein the speed limit setting is associated with maintaining an operating temperature of a track of the track assembly below a predetermined temperature threshold. In addition, the method may include automatically limiting, with the computing device, a vehicle speed of the work vehicle based on the determined speed limit setting.