A method of encoding image data, and an apparatus to perform the method, the method including repeating a process of dividing a block into sub-blocks based on an average value of pixels of the sub-blocks; creating map information of the sub-blocks; determining a mode for generating bit streams according to a number of the sub-blocks; and generating bit streams of the determined mode, map information, and representative pixel values of the block or the sub-blocks.