A noise level estimation module includes a pixel block selection module for selecting a plurality of selected pixel blocks over a set of K fields of a video signal, each of the plurality of selected pixel blocks containing a plurality of pixels having corresponding pixel values. A difference calculation module calculates a block difference for each of the plurality of selected pixel blocks based on a pixel difference between the pixel value for each of the plurality of pixels and a pixel value for a corresponding pixel in an adjacent field. A signal generator generates a noise level estimation signal based on a subset of M block differences for the plurality of pixel blocks, wherein M is greater than one.