This disclosure generally provides an input device that includes a by-pass path for improving latency between a touch controller and a display driver. In one embodiment, the by-pass path directly connects the touch controller and display driver, thereby by-passing a host processor (e.g., a central processing unit (CPU) or graphic processing unit (GPU)) in the input device. By doing so, the input device can detect user input and update a display to reflect the user input faster than if the display driver had to wait until updated display frames are sent from the host processor. For example, the host processor may transmit touch data received from the touch controller to an application that uses the touch data to change the display. In some input devices, this process can take hundreds of milliseconds, which may be enough time for the user to notice a delay.