A method (and system) of processing image data in which a depth map is processed to derive a modified depth map by analyzing luminance and/or chrominance information in respect of the set of pixels of the image data. The depth map is modified using a function which correlates depth with pixel height in the pixelated image and which has a different correlation between depth and pixel height for different luminance and/or chrominance values.