The present invention relates to an image enhancement unit and a method of enhancing a first structure (S1) of samples into a second structure (S2) of samples, the first and the second structure both representing a first property of a scene and having a first resolution, based on a third structure (S3) of samples representing a second property and having the first resolution, the first property and the second property respectively representing different properties of substantially the same scene. The method comprising generating a fourth structure (S4) of samples representing the first property, the fourth structure (S4) of samples having a second resolution lower than the first resolution, by down-scaling first samples of the first structure (S1) of samples to form the samples of the fourth structure (S4) of samples. The method further comprising up-scaling the fourth structure (S4) of samples representing the first property, into the second structure (S2) based on the third structure (S3) of samples, the up-scaling comprising assigning weight factors to respective samples of the fourth structure (S4) of samples based on samples of the third structure (S3) of samples; and computing samples of the second structure (S2) of samples using the samples of the fourth structure (S4) of samples and their respectively assigned weight factors. The invention further relates to an image-processing unit comprising an image enhancement unit according to the invention as well as to a computer program product.