Techniques manage connection between a user device (e.g., a tablet, a smartphone, a personal computer, a user workstation, etc.) and a peripheral device (e.g., an external mouse, a wireless keyboard, a wireless output device, other accessories, combinations thereof, etc.). Such techniques involve obtaining a current peripheral identifier from an operating system running on the user device, the current peripheral identifier identifying the peripheral device. Such techniques further involve, based on the current peripheral identifier, performing a peripheral recognition operation that attempts to recognize the peripheral device. Such techniques further involve, based on a result of the peripheral recognition operation, performing a peripheral access operation that determines whether the user device is allowed to connect with the peripheral device.