A method and system are provided for streaming a video game from a server to a client. One example system includes the server configured to generate video frames for the video game responsive to input received from the client. An encoder that processes the video frames to generate compressed video frames and storing past encoder states in memory associated with the encoder. The server is configured to transmit the compressed video frames to the client. The server is configured to receive a feedback signal from the client to determine when one or more of the compressed video frames that were sent were not been received by the client. The encoder is configured to generate one or more next video frames as compressed video frames that are dependent on compressed video frames that are known to have been successfully received based on the feedback signal.