In one example, a method of coding video data includes coding, from an encoded video bitstream, a syntax element that indicates a number of lines of video data that are in one or more of a plurality of sub-PUs of a current prediction unit (PU) of a current coding unit (CU) of video data. In this example, the method further includes determining, for each respective sub-PU of the plurality of sub-PUs, a respective vector that represents a displacement between the respective sub-PU and a respective predictor block from a plurality of previously decoded blocks of video data. In this example, the method further includes reconstructing each sub-PU of the plurality of sub-PUs based on the respective predictor blocks of video data.