Video data for a high resolution image unit is coded with regard to both a low resolution reference image unit and a high resolution reference image unit. In an example encoding implementation, both low pass information and high pass information of residue data for a current image are generated. In an example decoding implementation, a current image is reconstructed by synthesizing both low pass information and high pass information for the reconstructed image.