A system and method are provided for recommending a segment of a segmented video asset of particular interest to a client. A copy of a video asset is created such that the copy is in the form of a set of segments for being transmitted to a client device for playback. A relationship is established between start and end times of each segment relative to a standard version of segments of the video asset, and metadata is generated for each segment of the copy. The metadata and relationship is used relative to the standard version with viewing data collected across a population of viewers having viewed the video asset to produce viewing metrics for each segment of the set of segments of the copy. The viewing metrics are provided to a recommender which uses the viewing metrics to generate a recommendation of a segment of the copy to a client.