A method of video decoding at a video decoder can include partitioning a coding tree block (CTB) into coding blocks, determining whether an intra sub-partition (ISP) mode is allowable for a current block based on a first block size of the current block that is one of the coding blocks, and decoding the current block according to the ISP mode when the ISP mode is allowed for the current block.