In a device and a method for detecting a letter box for an MPEG decoder, the method includes performing processing area filtering for selecting a processing area of an image used to detect the letter box; performing intra-macroblock filtering for determining the letter box area based on a change level of pixels in macroblocks in one line of the image from the processing area; performing impulse data filtering for excluding the line being detected a high frequency component from the determined letter box area; performing inter-macroblock filtering for determining the letter box area based on a change level of lines between macroblocks of the image; performing inter-line filtering for determining a boundary of the letter box based on an average of the pixel values of the lines; and performing inter-picture filtering for outputting a boundary value of the letter box that has the highest frequency number as the boundary of the letter box in successive images.