In one aspect, an arteriovenous access valve system may generally include a first valve configured to be positioned at or adjacent to an end of arteriovenous graft and a second valve configured to be positioned at or adjacent to an opposite end of the arteriovenous graft. In addition, the system may include an actuator assembly in fluid communication with the first and second valves. The actuator assembly may include a housing, a driver assembly positioned within the housing and a drive magnet positioned within the housing. The drive magnet may be rotatably coupled to the driver assembly such that, when the drive magnet is rotated, the driver assembly is configured to be rotatably driven so as to supply fluid to the first and second valves or to draw fluid out of the first and second valves depending on a rotational direction of the driver assembly.