Systems and methods are provided herein relating to audio matching. In addition to interest points, localized patches surrounding interest points can be used as additional discriminative information. The patches can be compressed to increase scalability while retaining discriminative information related to the localized region within the patch. Compressed patches related to interest points of an audio sample can be compared to compressed patches related to interest points of a reference sample to determine whether the two samples are a match.