An image feature extraction device according to an embodiment includes a gradient image calculator generates intensity gradient data with respect to two different directions based on intensity data of image data; and a gradient count unit calculates a covariance matrix for each partial area obtained by dividing the image data based on the intensity gradient data. The image feature extraction device according to the embodiment further includes a feature data output unit calculates two parameters related to a major axis and a minor axis of an ellipse expressed by the covariance matrix, quantizes a range of the logarithms of the parameters for each of the partial area using a predetermined division number, and outputs a feature vector which contains a value only at a dimension corresponding to the quantized range different from the other dimensions.