A remote control system and method for controlling and interacting with a variety of devices and systems is disclosed. The system comprises at least one command server which is operable to receive control commands from a handheld communications device and to generate and transmit command signals in response to the received control commands, the transmitted command signals interacting with one or more devices controlled by the system. In one embodiment, the handheld communications device is operable to exchange data with an account server that maintains data and configuration information for the system and the devices to be controlled by it over a first communications modality. The handheld communications device transfers control commands and other data with the command server via a second communications modality and the handheld communications device can transfer data between the account server and the command server as needed. The system can support multiple devices to be controlled, multiple command servers, which can each be associated with one or more devices to be controlled, and multiple handheld communications devices.