A video transform method includes: receiving a quantized transform coefficient for a target block and a transform index for a non-separated secondary transform; inverse-quantizing the quantized transform coefficient; deriving an input transform coefficient size indicating the length of the inverse-quantized transform coefficient to which the non-separated secondary transform has been applied, an output transform coefficient size indicating the length of a modified transform coefficient to which the non-separated secondary transform has been applied, and a transform set mapped to the intra mode of the target block, when the transform index does not indicate that the non-separated secondary transform is not performed; and deriving the modified transform coefficient on the basis of a matrix operation on a transform kernel matrix in the transform set indicated by the transform index, and a transform coefficient list corresponding to the input transform coefficient size.