A video encoder is provided that has: one or more encoder plug-ins that provide a wrapper for one or more respective base codecs to implement a base encoding layer, each wrapper implementing an interface for data exchange with a corresponding base codec, the base encoding layer being configured to encode and decode a video signal; an enhancement encoder to implement an enhancement encoding layer, the enhancement encoder being configured to: receive a decoded video signal from one of the one or more encoder plug-ins, the decoded video signal comprising a decoded version of an encoded video signal generated by said one of the one or more encoder plug-ins, and generate an encoded enhancement signal for the encoded video signal, the encoded enhancement signal comprising one or more layers of residual data, the residual data being generated based on a comparison of data derived from the decoded video signal and data derived from an input video signal, and, an encoder integration layer to control operation of the one or more encoder plug-ins and the enhancement encoder to generate an encoding of the input video signal using the base encoding layer and the enhancement encoding layer, wherein the encoder integration layer provides a control interface for the video encoder. A system, methods and computer readable medium are also provided.