A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. A graphical user interface is presented that enables a user to edit highlighting to select portions of a conference recording for inclusion in the conference summary. The user can edit highlighting on strings of a transcript and/or on a playback slide bar and the highlighting edits are propagated to both of these interfaces. Video clips selected for inclusion in a summary based on timestamps of strings in a transcript may be extended forward in time to incorporate a nearest I-frame of video. The short video or audio summary may be presented to users along with a text summary of the conference to enable efficient storage and transmission of information from the conference within a unified communications system.