An information processing apparatus capable of connecting to a plurality of terminal devices over a network includes a recording/reproducing unit configured to receive a removable memory medium, a detector configured to detect insertion and removal of the removable memory medium in and from the recording/reproducing unit, and a controller configured to acquire first information identifying a terminal device which is recorded in the removable memory medium when the detector detects the insertion of the removable memory medium and to control permission and prohibition of access to the removable memory medium from the terminal devices based on the first information.