Aspects of a method and system for redundancy-based decoding of video content are provided. A bit sequence comprising video content may be decoded in a multilayer process based on a decoding algorithm and at least one physical constraint. The decoding algorithm may be based on the Viterbi algorithm. Whether the bit sequence comprises video content may be determined based on information provided by a portion of a packet header or by packet priority information necessary for enabling quality of service applications. The physical constraint may be based on border, DC component, and/or low frequency continuity between neighboring discrete cosine transform (DCT) blocks. The physical constraint may also be based on the consistency of video data coded by a variable length coding (VLC) operation. At least one physical constraint test may be performed on selected estimated video bit sequences to select a decoded output video bit sequence.