Methods and apparatus are provided for recognizing particular objects of interest in a captured image. One or more salient features that are correlative to an object of interest are detected within a captured image. The captured image is segmented into one or more regions of interest that include a detected salient feature. A covariance appearance model is generated for each of the one or more regions of interest, and first and second comparisons are conducted. The first comparisons comprise comparing each of the generated covariance appearance models to a plurality of stored covariance appearance models, and the second comparisons comprise comparing each of the generated covariance appearance models to each of the other generated covariance appearance model. Based on the first and second comparisons, a determination is made as to whether each of the one or more detected salient features is a particular object of interest.