One embodiment of the present invention provides a system for recognizing a feature of an image independently of the orientation or scale of the image. During operation, the system receives an image. Next, the system identifies a feature within the image. The system then performs a principal component analysis (PCA) operation on the feature to determine an orientation of a primary component of the feature and a secondary component of the feature, wherein the PCA operation is performed while source data for the image is retained. Finally, the system recognizes the feature by analyzing the primary component of the feature and the secondary component of the feature.