A system and method for detecting artifacts in a video having a sequence of pictures is described. The method comprises the steps of calculating a motion vector cost and a variable threshold for each of the pictures. In case, the motion vector cost for the picture is greater than the variable threshold of the picture, then a first scene change profile and a second scene change profile for the picture is computed and analyzed for determining the character of the variation in the motion vector cost. An artifact metric for the picture is also calculated and the artifact metric for the picture is compared with a programmable artifact reporting threshold for ascertaining if an artifact is present in the video. The described approach is generic in nature and takes into account various exceptions that may be present within a picture that may be similar in character as an artifact.