Provided is an apparatus for processing a video. The apparatus for processing a video includes an image receiving module that is configured to receive encoded data, a filtering module that is configured to filter an image frame reconstructed from the encoded image, a block dividing module that is configured to divide the filtered image frame into a plurality of blocks, a compression module that is configured to compress each of the plurality of blocks, package the compressed plurality of blocks into a predetermined unit, and generate lookup table information corresponding to each of the packaged plurality of blocks, and a frame buffer memory that is configured to record the packaged data and the lookup table information.