An information processing apparatus includes a feature amount extraction unit extracting a feature amount of each frame of an image, a maximum likelihood state series estimation unit estimating maximum likelihood state series using the feature amount, a highlight label generation unit generating highlight label series with respect to the attention detector learning content, and a learning unit learning the highlight detector that is the state transition probability model using learning label series that is a pair of the maximum likelihood state series obtained from the attention detector learning content and the highlight label series.