Systems and methods are described for using video fingerprinting to detect depiction of one or more objects of interest in video data. An object of interest may first be identified in one or more frames of video data. A system may then create a digital video fingerprint representing the one or more frames in which the object is depicted. A potentially large amount of subsequent video data may then be received or retrieved, and the system may determine that the object appears in a portion of the subsequent video data based at least in part by identifying that the digital video fingerprint at least substantially matches a portion of the subsequent video data.