A peripheral device is tracked between connections to host devices. A peripheral driver is dynamically configured and associated with a peripheral of a host device. A current association between the peripheral device and a current host device is maintained for purposes of providing the peripheral driver of the peripheral device on the current host device to remotely executing applications. The association is dynamically changed/updated based on a connection between the peripheral device and a given host device.