Entropy encoding and decoding a sequence of symbols using probability mixing is disclosed. A method includes for at least a symbol, at a position of the symbols, determining a mixed probability, by: approximating a first conditional probability for coding the symbol, the first conditional probability being a conditional probability of the symbol given a sub-sequence of the sequence having a first value; approximating a second conditional probability for coding the symbol, the second conditional probability being a conditional probability of the symbol given the sub-sequence having a second value; and determining, using the first conditional probability and the second conditional probability, the mixed probability for coding the symbol; and coding the symbol using the mixed probability.