An image processing apparatus that compresses moving-picture data includes an image converter configured to decimate pixels in individual blocks that are defined by dividing moving-picture frames, the image converter being configured to generate a plurality of layer signals using different sampled pixels corresponding to representative pixels in pixel decimation; and an encoder configured to receive input of the plurality of layer signals generated by the image converter and to generate encoded data based on the layer signals.