An apparatus, a content retrieval method and a program facilitate recognizing content details of a moving image by displaying a retrieval result for each of a plurality of images. A metadata extracting unit extracts metadata of a representative image from content supplied from a content input unit and stores the metadata in a metadata database. An image feature quantity extracting unit extracts image feature quantity from content and stores it in an image feature quantity database while extracting image feature quantity from a retrieval image. A retrieving unit compares the image feature quantity of the retrieval image with the image feature quantity stored in the image feature quantity database and specifies a still image which is similar to the retrieval image. An output unit reads metadata of the content, generates display data necessary for performing timeline displaying, and generates display data for displaying a retrieval result on a timeline.