An image displaying device and a method for controlling color thereof. The image displaying device includes a lattice selection unit which selects a lattice of a look-up table (LUT) for reference of each pixel of an input image, a lattice control unit which determines whether the selected lattice requires to be changed for color adjustment and calculates a change degree of the lattice, an LUT conversion unit which converts the LUT by changing the lattice based on the calculated change degree, and a lattice reference/interpolation unit which refers to or interpolates the lattice based on the converted LUT. Accordingly, the LUT can be updated real time, thereby realizing more accurate adjustment of color.