Systems and methods to track objects in video are disclosed. Exemplary implementations may obtain a user entry and/or selection of a depiction of an object visible within a first frame of a video and process the depiction of the object for use as a current reference. For subsequent frames, the systems and methods may determine whether the depiction of the object is visible. If the depiction of the object is no longer visible within a particular frame, image features of subsequent frames are compared with the latest reference of the depiction of the object until the depiction of the object is visible again. If and when the object is visible, an object indicator may be displayed on the relevant frames and/or otherwise presented to a viewer.