Systems and methods of detecting dead pixels of image frames are described including receiving a sequence of image frames, aligning, from the sequence of image frames, pairs of image frames, and for a given pair of image frames, determining differences in intensity of corresponding pixels between the aligned pair of image frames. The method also includes, based on the differences in intensity of corresponding pixels between the aligned pair of image frames, generating mask images indicative of areas in the pairs of image frames having moving objects. The method further includes determining, within the mask images, common pixel locations indicative of areas in the pairs of image frames having moving objects over a portion of the sequence of image frames, and based on a number of the common pixel locations for a given pixel location being above a threshold, identifying the given pixel location as a dead pixel.