A method for signaling scaling matrices for transform coefficient quantization is provided. A decoder receives data from a bitstream to be decoded as a current picture of a video, the current picture to be decoded by using a plurality of scaling matrices. The decoder receives a reference index offset for a first scaling matrix of the plurality of scaling matrices. The decoder applies the reference index offset to a first index identifying the first scaling matrix to derive a second index identifying a second scaling matrix of the plurality of scaling matrices. The second scaling matrix is previously reconstructed. The decoder reconstructs the first scaling matrix by referencing the second scaling matrix. The decoder dequantizes transform coefficients of transform blocks of the current picture by using the plurality of scaling matrices and reconstructs the current picture by using the dequantized transform coefficients.