Various embodiments calculate a score for each frame of a video segment based on various subject-related factors associated with a subject (e.g., face or other object) captured in a frame relative to corresponding factors of the subject in other frames of the video segment. A highest-scoring frame from the video segment can then be extracted based on a comparison of the score of each frame of the video segment with the score of each other frame of the video segment, and the extracted frame can be transcoded as an image for display via a display device. The score calculation, extraction, and transcoding actions are performed automatically and without user intervention, which improves previous approaches that use a primarily manual, tedious, and time consuming approach.