The selective rejection of touch contacts in an edge region of a touch sensor panel is disclosed. In addition, by providing certain exceptions to the rejection of edge contacts, the functionality of the touch sensor panel can be maximized. Contacts in edge bands around the perimeter of a touch sensor panel can be ignored. However, if a contact in the edge band moves beyond a threshold distance or speed, it can be recognized as part of a gesture. To accommodate different finger sizes, the size of the edge band can be modified based on the identification of the finger or thumb. Furthermore, if contacts in the center region of a touch sensor panel track the movement of contacts in the edge band, the contacts in the edge band can be recognized as part of a gesture.