In accordance with one aspect of the disclosure, a remote control device includes a transceiver configured to communicate with a user terminal or a vehicle, a sensor configured to obtain a motion information, a storage configured to store a motion table including at least one designated motion and at least one function matched thereto, and a controller configured to identify whether the designated motion corresponding to the obtained motion information exists among at least one designated motion included in the motion table, generate a control command for performing at least one function matching the designated motion corresponding to the obtained motion information based on the identification result, and control the transceiver to transmit the generated control command to the user terminal or the vehicle.