Disclosed herein are systems, methods, and non-transitory computer-readable storage media for controlling a user interface. A system configured to practice the method displays a user interface element, such as a knob, on a touch-sensitive display. The system receives input from a user associated with the user interface element via the touch-sensitive display. For example, the user can provide input to the knob via a tap, twist, flick, press-and-hold, drag, slide, or other touch-based input with a single or multiple fingers or other points of contact. The system matches the input to an input category selected from a group of predefined input categories for the user interface element, and updates the user interface element based on the input and based on the input category. The system can also update a value represented by the user interface element, such as a value that affects output or other settings of a software application.