An indirect interaction input device, such as but not limited to a touch sensor, can provide multiple points of input. These multiple points are in turn mapped to multiple positions on an output device such as a display. The multiple points of input, however, make the application of pointer ballistics and resolution differences between the input sensor and target display more difficult to manage. Thus, a characteristic of the set of points is identified and used to adjust the mapping of each of the points. For example, one way to solve this problem is to identify the input point with the least displacement from a prior frame, whether from its prior point or from a reference point. This displacement is used to adjust the mapping of the set of input points from the input device to their corresponding display coordinates.