Techniques for implementing video processing techniques are described. In one example implementation, a method of video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, a modified motion vector set; and performing the conversion based on the modified motion vector set. Due to the current block satisfying a condition, the modified motion vector set is a modified version of a motion vector set associated with the current block.