A user interface of a video conference system includes a bi-axial display of highlight information corresponding to highlights designated by participants in a video conference. The biaxial display shows highlights organized in timeline fashion within a panel arranged alongside a display of conference participants, and indications of those highlights within a timeline associated with the display of conference participants. The highlights organized in timeline fashion within the panel may include spaces for comments by the conference participants. Moreover, the panel may be configurable to display either the spaces for comments by the conference participants or an annotated transcript of the video conference, the transcript being annotated with indicators of instances of the highlights.