Systems and methods for implementing one or more autonomous features for autonomous and semi-autonomous control of one or more vehicles are provided. More specifically, image data is obtained from an image acquisition device and processed utilizing one or more machine learning models to identify, track, and extract one or more features of the image utilized in decision making processes for providing steering angle and/or acceleration/deceleration input to one or more vehicle controllers. In some instances, techniques are employed such that the autonomous and semi-autonomous control of a vehicle changes between lane follow and vehicle follow modes. Further, a vehicle may determine whether to continue to follow a vehicle after the followed vehicle moves in relation to the following vehicle.