A system for detecting scan and non-scan events in a self-check out (SCO) process includes a a scanner for scanning objects and generating point of sale (POS) data, a video camera for generating a video of the scanning region, proximity sensors proximal to the video camera for defining an Area of Action (AoA), wherein the video camera starts capturing scanning region, when the objects enter the AoA, and the POS data includes non-zero values, an Artificial neural network (ANN) for receiving an image frame and generating one or more values, each indicating a probability of classification of the image frame into one or more classes respectively, and a processing unit for processing the POS data, and probabilities of one or more classes to detect a correlation between video data and POS data, and detect one of: scan and non-scan event in the image frame based on the correlation.