A method, system and computer program product for measuring non-uniformity noise produced in images or videos (e.g., infrared images or videos). Images or videos, such as infrared images or videos, are captured. A model of scene statistics (statistical model of pictures, images or videos representative of pictures, images or videos, respectively, that are captured of the physical world) is utilized to measure the non-uniformity noise in the captured images or videos by exploiting exhibited characteristics for non-uniformity noise in the captured images or videos. A number signifying a magnitude of non-uniformity for each image or video frame is then generated. In this manner, non-uniformity noise produced in images or videos is measured.