A video decoding method includes: performing entropy decoding on a coding block of a video image frame to obtain a quantization coefficient block of residual data corresponding to the coding block; inversely quantizing the quantization coefficient block to obtain an inverse quantization coefficient matrix; inversely rearranging the inverse quantization coefficient matrix to obtain a processed coefficient matrix, non-zero coefficients in the processed coefficient matrix being concentrated in left, upper and upper left regions of the coefficient matrix; and generating the residual data according to the processed coefficient matrix.