Methods and apparatus are described for assessing the video image decoding quality of a set top box (STB), television receiver or other video device. Moving video testing of video delivery hardware in a manufacturing environment uses a video sequence that has reference characteristics embedded in the visible portion of the video signal from frame to frame. Each frame of the video is analyzed for distortions of the embedded reference objects, and the reference objects are allowed to move from frame to frame. The reference objects are located through the use of a background that is easily discriminated from the objects and by the use of frame templates that locate the reference information in the frame.