In an embodiment, a processor includes a core to execute instructions, a power controller to control an operating frequency of the core, and a context filter logic coupled to the power controller to prevent a performance state change request from being granted by the power controller based at least in part on a context of a system including the processor. Other embodiments are described and claimed.