A method and apparatus for handling restricted access and server/client handoffs in a communication environment is described. In one embodiment, the method includes receiving a first request for a first set of image data corresponding to an image, and responding to the first request with the first set of image data. The method may also include receiving a second request for a second set of image data corresponding to the image and determining that the second set of image data includes restricted data. A prompt for authentication may then be sent. The method may also include receiving the second request along with authentication information, determining again that the second request is for restricted data, and checking the authentication information. If the authentication information is correct, the method may also include providing the second set of image data.