Defining a handoff zone for tracking a vehicle between cameras is disclosed. Initially, a first image stream is received from a first camera having a first field of view. A second image stream is also received from a second camera having a second field of view, where the second field of view is different from and at least partially overlapping with the first field of view. Next, an overlap area that defines the overlap between the first image stream and the second image stream is determined. A handoff zone within the overlap area is then determined, where tracking of the vehicle is passed from the first camera to the second camera after the vehicle enters the handoff zone. Finally, boundaries of the handoff zone are stored.