A video decoder, and corresponding method are described for enabling fast channel change of compressed video, where a video decoder for receiving compressed stream data and providing decompressed video output includes receiving the compressed stream data and separating the normal stream and the channel change stream, a normal decoding portion for selectably receiving the compressed normal and channel change streams, and providing decompressed video output, and a normal frame store in signal communication with the normal decoding portion for storing reference pictures.