Video data from sources, such as cameras, is analyzed to create metadata descriptive of the events and objects occurring in the video. This metadata, which consists of data about the video, is then analyzed on a transaction basis to determine if a suspicious activity, such as a fraudulent Point of Sale (POS) return event, has occurred in relation to a transaction.