An interaction system and method for interaction between a handheld device and a television comprises the configuration and connection of a first HDMI transferring module and a television screen in addition to a configuration and connection of a second HDMI transferring module, a touch screen, a gesture managing module and a display managing module. A user interface system and method for interaction between a handheld device and a television can utilize a handheld device having a touch screen to operate the television without requiring the assistance of other hardware units, such as a mouse or keyboard. All the operations can be done by using only the handheld device, thereby reducing the costs of devices.