A device for decoding video data can be configured to perform a multi-pass inverse transformation on a plurality of values to derive residual data that represents pixel differences between a current block of video data and a predictive block of the video data, wherein to perform a pass of the multi-pass inverse transformation, the device is configured to determine at least two matrices, wherein the at least two matrices comprise a first matrix and a second matrix; determine at least two vectors, wherein the at least two vectors comprise a first vector and a second vector; and perform at least two matrix-vector computations, wherein the at least two matrix-vector computations comprise a first matrix-vector computation based on the first matrix and the first vector and a second matrix-vector computation based on the second matrix and the second vector.