Efficient channel surfing in a compressed frame television system is provided by receiving and storing compressed frames representing unwatched channels. Then, when a viewer selects one of the unwatched channels for viewing, the corresponding compressed frame is retrieved from memory and is displayed until a sufficient number of frames are received for that channel to provide for normal viewing of that channel. Corresponding audio clips may also be stored in memory and retrieved and played when the corresponding channel is selected for viewing. Program data may also be stored for unwatched channels for later retrieval and display. Preferably, one tuner/decoder pair is utilized to display programs for selected channels, while a second tuner/decoder pair is utilized to capture and store compressed frames for unwatched channels.