System and method for detecting a fraudulent activity at a barcode scanner is disclosed. The method issues an alert when the fraudulent activity is confirmed by comparing the visual signature of the item being transacted over the checkout terminal to the model visual signature. The model visual signature is obtained by averaging the collection of visual signature of the item gathered over a period of time. A human validation via a remote processor is employed to confirm the fraudulent activity verified by a computer.