Provided is a visual axis direction detection device capable of obtaining a highly accurate visual axis direction detection result without performing a particular calibration for each of examinees. The device (100) includes: a feature calculation unit (160) which calculates as a reference position, a 3D position of the center of a face of an examinee whose visual axis direction is to be detected, from a 3D position of two face parts positioned symmetrically, and calculates as a feature position, a 3D position of the center of the right and left pupils of the examinee in the horizontal direction; a visual axis direction feature amount calculation unit (172) for calculating a shift amount of the feature position from the reference position in the horizontal direction as a visual axis direction feature amount; and a visual axis vector calculation unit (173) for calculating the visual axis direction of the examinee according to the visual axis direction feature amount.