There is provided an attention position recognizing apparatus, an image pickup apparatus, a display apparatus, an attention position recognizing method, and a program, in which it is possible to reliably recognize a position of a portion, to which attention is paid by a user, in an image. A gaze analyzing unit that performs detection of a gaze position of the user and determination of whether or not the gaze position is stable, as a gaze analysis of the user, an image analyzing unit that performs image analysis of the acquired image, and an attention position recognizing unit that recognizes an attention position which is a position of a portion in the image, to which attention is paid by the user, based on the result of the gaze analysis and the result of the image analysis.