Personal audio systems and methods are disclosed. A personal audio system includes a class table storing processing parameters respectively associated with a plurality of annoyance noise classes, a controller, and a processor. The controller identifies an annoyance noise class of an annoyance noise included in an ambient audio stream and retrieves, from the class table, one or more processing parameters associated with the identified annoyance noise class. The processor to processes the ambient audio stream according to the one or more retrieved processing parameters class to provide a personal audio stream. The processor includes a pitch tracker to identify a fundamental frequency of the annoyance noise and a filter bank including a band reject filter tuned to the fundamental frequency.