A lossless decoding unit 52 takes quantization parameters of decoded blocks spatially or temporally adjacent to a block to be decoded, as selection candidates, and extracts, from stream information, difference information indicating difference as to a prediction quantization parameter selected from the selection candidates. A quantization parameter calculating unit 59 calculates, from the prediction quantization parameter and the difference information, a quantization parameter of the block to be decoded. Thus, decoding of the image can be performed correctly by calculating a quantization parameter equal to a quantization parameter used at the time of image encoding.