In one embodiment, a method determines a scaled motion vector for a first block. A motion vector for a second block is determined where the motion vector is on a non-uniform motion vector grid. The method then maps the motion vector for the second block to a higher accuracy uniform motion vector grid that is of a higher accuracy than the non-uniform motion vector grid and scales the motion vector for the second block on the higher accuracy motion vector grid. The scaled motion vector is mapped on the higher accuracy motion vector grid to the non-uniform motion vector grid. The scaled motion vector on the non-uniform motion vector grid is associated with the first block for a temporal prediction process.