An apparatus includes a memory and a processing device comprising touch sorting logic. The touch sorting logic sorts the raw touch position data in two stages. In each of the stages, the touch sorting logic predicts the centroid positions for each touch of the plurality of touches, compares the predicted centroid positions for each touch and indexes the centroid position for each touch based on the predicted centroid position that is closest to the raw touch position data. The sorted touch position data is sorted according to the touch index assigned to each of the centroid positions for each of the plurality of touches.