A method and related apparatus for restraining erroneous image colors are provided for correcting pixel values of three sequential image fields of a video data while de-interlacing the video data. The method is utilized to correct the video data by detecting whether penetrations from luminance signals into chrominance signals or penetrations from chrominance signals into luminance signals occur in the video data. In embodiments of the present invention, the pixel chrominance signals of image fields with the same polarity are utilized to correct the pixel chrominance signals of another image field. Pattern matching and edge detection are utilized to determine whether penetrations from chrominance signals into luminance signals occur.