Audio data describing an audio signal may be received and used to determine a set of frames of the audio signal. One or more potential music events may be determined in the audio signal using a spectral analysis of the set of frames. The audio signal may be analyzed for one or more potential noise or tone events. One or more music states of the audio signal may be determined based on the one or more potential music events and a presence or absence of the one or more noise or tone events. Audio enhancement of the audio signal may be modified based on the one or more determined states of the audio signal.