Various embodiments for switching programs streams using a variable speed program stream buffer coupled to a variable speed decoder are described. In one or more embodiments, the variable speed program stream buffer may be arranged to receive multiple program streams, such as video program streams, and to buffer historical frames comprising at least one anchor frame. The variable speed program stream buffer may be arranged to always comprise at least one anchor frame and may be implemented by running and/or elastic buffers corresponding to an active channel program stream and one or more alternate channel program streams. Upon detecting a channel switch point, the historical frames comprising the anchor frame up to the channel switch point may be provided to the variable speed decoder in an accelerated manner. The historical frames may be provided to the variable speed decoder in a very short time instant or burst, such as within a time interval of one frame count or less, to enable the variable speed decoder to catch up to the notion of real time. Other embodiments are described and claimed.