A remote control system and method is provided for remote-controlling a target apparatus using a mobile communication terminal. The mobile communication terminal senses a movement of the mobile communication terminal to measure current position information, acceleration information and angular velocity information of the mobile communication terminal according to the movement, and generates pointer motion information for a pointer of the target apparatus using a distance from the target apparatus and the measured information. The target apparatus receives the generated pointer motion information from the mobile communication terminal, and shifts the pointer being three-dimensionally displayed, according to the received pointer motion information.