A tracking loop of an interpolator based receiver includes clock elements that generate a plurality of clocks to sample a signal from a remote transmitter. The tracking loop includes samplers and voter elements that sample the signal with the clocks and generate samples that comparatively indicate a phase relationship between the signal and the clocks. Based on the comparison of the samples in the samplers and voter elements, the tracking loop either sends phase-shift signals to the clock elements to shift the phase of the clocks to match the phase of the signal, or sends a phase-flip signal to the clock elements to flip the clocks if the phase relationship between the signal and the clocks is about 180°. Once a phase match between the clocks and the signal is established, the tracking loop remains phase locked with the signal and provides a recovered signal.