The present invention relates to a method and system of improved pointer recognition. A camera-based interactive system has two cameras with fields of view observing an interactive surface. A processor receives a plurality of video frames from the cameras and recognizes a pointer within the video frames. Motion blur of the pointer is compensated to determine the pointer type from the compensated frames using a model-based approach.