A color reconstruction system for an SECAM television signal includes a luminance and chrominance separator and color decoder, first and second line buffer blocks, a vertical similarity calculator and a reconstructor. The luminance and chrominance separator and color decoder receives and filters an SECAM television signal with a luminance and a chrominance to produce a luminance signal and a chrominance signal. The first line buffer block temporarily stores the luminance signal. The second line buffer block temporarily stores the color difference signal. The vertical similarity calculator produces an upper similarity coefficient and a lower similarity coefficient based on the luminance signals produced by the luminance and chrominance separator and color decoder and temporarily stored in the first line buffer block respectively. The reconstructor depends on the upper and lower similarity coefficients to adjust the chrominance signal temporarily stored in the second line buffer block to produce a reconstructed chrominance signal.