In one aspect, a system for controlling an operation of agricultural implements may include a work vehicle configured to tow an implement. The work vehicle may include a hitch assembly having a draw point configured to be coupled to the implement. The work vehicle may further include an actuator configured to move the draw point relative to the hitch frame to adjust the position of the implement relative to the work vehicle. The implement may include a sensor configured to detect an operational parameter indicative of the operation of the implement. Additionally, the implement may further include a controller communicatively coupled to the sensor, with the controller being configured to initiate control of an operation of the actuator based on sensor data received from the sensor to adjust the operational parameter of the implement.