A Personal TV System receives a plurality of video segments constituting a TV program and information describing each segment, and controls the display of the segments to a viewer in accordance with preferences of the viewer and with the description of each segment. Segments may be omitted or replaced with substitute segments. The viewer may review his preferences and edit or replace them. In a multi-viewer household, the system may prompt a viewer to confirm her preferences. A TV program may contain interactive segments, and when the viewer chooses to interact with a particular segment, the system automatically stores all subsequently received segments for later viewing while the viewer interacts with the selected segment. The system may present TV program choices to the viewer selected and arranged in accordance with her preferences.