Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for adjusting of video analytics rules for camera movement. The methods, systems, and apparatus include actions of obtaining a rule that specifies a first set of coordinates applied to a first set of images from a camera, determining an amount and direction of movement of the camera after the rule was obtained, determining, based on the amount and direction of movement of the camera, a second set of coordinates applied to a second set of images captured after the camera moved.