Systems and methods for performing fraud detection at POA devices based on analysis of feature sets are disclosed. In one embodiment, an exemplary method may comprise: obtaining, by a POS device, upon initiation of a transaction involving a card or a card and mobile device associated with an individual initiating the transaction, one or more sensory inputs and an identifier; mapping, by the POS device, the one or more sensory inputs to a first cluster position of a plurality of clusters; determining whether the cluster position of the cluster mapped for the transaction corresponds to a second cluster position of the at least one expected cluster associated with the known owner of the card and/or mobile device; and initiating, by the POS device, at least one second factor authentication process to establish that the individual is the known owner of the card and/or mobile device being used in the transaction.