A method and system for detecting and estimating noise in a video signal. For example, detail edges may be identified in a plurality of pixels, wherein each detail edge has an edge magnitude value. The detail edges in the plurality of pixels may be identified by: determining one or more directionality values for the plurality of pixels by passing the input video signal through at least one directional filter, and identifying the detail edges by assigning edge magnitude values based on whether the one or more directionality values exceed predetermined threshold levels. An edge map of the detail edges may be created, where the edge map is configured to indicate areas of the plurality of pixels to be considered or ignored in estimating the noise in the input video signal. The noise in the input video signal may then be estimated based on the indicated areas of the edge map.