An automated creation of a summary video based on video segments extracted from several videos by using a social network of viewers and a social curve specified by a user in order to select and order the video segments. A social network of viewers (influence scores, experts) may be used to establish metrics for video segments. A social curve may be defined with respect to the video segment metrics to allow for the automatic creation of a summary video.