A system for using a mobile communication terminal as a pointer and a method and medium thereof are disclosed, in which information displayed on a head mounted display (HMD) can be controlled by using the mobile communication terminal as the pointer. The system includes a head mounted display device receiving an input of an image of a background having a marker, and the mobile communication terminal searching for the position of the marker by detecting the marker from the image of the background having the marker transmitted from the head mounted display device, and providing the pointer to the searched position. The head mounted display device displays the pointer provided by the mobile communication terminal.