A haptic feedback system includes a user interface device, such as a touchscreen that includes a touch panel and one or more haptic drive elements coupled to the touch panel, a touch controller, and an actuator controller. The touch controller receives sensed data from the touch panel, and in response generates and sends a haptic signal to an actuator controller. Generation and transmission of the haptic signal bypasses any system host controller. A dedicated signal path couples the touch controller and the actuator controller, over which the haptic signal is transmitted. Alternatively, the haptic signal is transmitted from the touch controller to the actuator controller over a serial bus interface. In response to the received haptic signal, the actuator controller implements an appropriate drive signal in the form of a haptic waveform to the one or more haptic drive elements of the touchscreen.