A method of generating motion vectors for image data includes identifying boundaries of at least one object in original frames of image data, performing object motion analysis based upon the boundaries, performing pixel-level motion layer generation, using the object motion analysis and the pixel-level motion layers to generate motion for blocks in the image data, and producing block level motion information and layer information for the original frames of image data.