An interactive input system, method and computer readable medium for handling objects representing annotations on an interactive input system are disclosed. The method includes creating an annotation on the interactive input system, associating the annotation with a temporary grouping region, and in the event that a threshold amount of time passes before a further annotation is created within a threshold distance of the temporary grouping region, disabling the temporary grouping region to thereafter prevent automatic grouping with the annotation of any further annotation.