A video processing system includes a host processor, a video encoder and a memory. The host processor sends a configuration message to the video encoder that indicates to the video encoder how to encode a video frame and that includes information indicating the location of encoding configuration data that is stored in the memory. The video encoder receives the configuration message, uses the location indicating information to read the encoding configuration data from the memory, and encodes the video frame in accordance with the encoding configuration data read from the memory.