A method for video decoding includes: dividing a plurality of luma component data of a reference frame into a plurality of primary data and a plurality of secondary data, respectively stored in a first memory region and a second memory region; accessing the first memory region to perform a motion estimation; and accessing the second region to perform a luma motion compensation.