The image data are coded with field DCT or frame DCT depending on the characteristics of the image data. However different coding types will result in different boundary marks of boundaries between adjacent blocks or adjacent macro blocks. Therefore the de-blocking of a boundary between two adjacent blocks or adjacent macro blocks should be performed according to the format of image data and the coding type of the adjacent blocks or adjacent macro blocks.