There is provided a communication control device including: a data storage unit storing feature data representing features of appearances of one or more communication devices; an environment map building unit for building an environment map representing positions of communication devices present in a real space based on an input image obtained by imaging the real space and the feature data stored in the data storage unit; a detecting unit for detecting a user input toward a first communication device designating any data provided in the first communication device and a direction; a selecting unit for selecting a second communication device serving as a transmission destination of the designated data from the environment map based on the direction designated by the user input; and a communication control unit for transmitting the data provided in the first communication device from the first communication device to the second communication device.