A method for determining an as-driven path of an agricultural work vehicle includes receiving position data indicative of a position of the agricultural work vehicle in a field during a first pass of the agricultural work vehicle in the field, receiving inertial movement data of the agricultural work vehicle during the first pass, and receiving operational data indicative of at least one of a steering angle of a wheel of the agricultural work vehicle, a wheel speed of the wheel of the agricultural work vehicle, or a transmission speed of the agricultural work vehicle during the first pass. Moreover, the method includes generating an as-driven path of the agricultural work vehicle during the first pass based at least in part on the position data, the inertial movement data, and the operational data. Additionally, the method includes performing a control action based on the as-driven path.