A video decoding method performed by a decoding apparatus includes deriving one of a plurality of cross-component linear model (CCLM) prediction mode as a CCLM prediction mode of the current chroma block, deriving a sample number of neighboring chroma samples of the current chroma block based on the CCLM prediction mode of the current chroma block, a size of the current chroma block, and a specific value derived as 2. The method includes deriving the neighboring chroma samples of the sample number, calculating CCLM parameters based on the neighboring chroma samples and the down sampled neighboring luma samples, deriving prediction samples for the current chroma block based on the CCLM parameters and the down sampled luma samples and generating reconstructed samples for the current chroma block based on the prediction samples.