Systems and methods of the present disclosure physical object-based passwords by registering an object password including first object representations, first background scene representations, and a first presentation sequence from first image data. Receiving second image data and a second presentation sequence that is a second order in which the user has presented second physical objects to an image acquisition device, and detecting in the second image data second object representations of the second physical objects, and second background scene representations. Computing a probability that the user is a permissioned user by inputting the first image data and the second image data into a machine learning model configured to compute the probability based on comparing the object password and the second image data. Tagging the user as the permissioned user or non-permissioned user based on the probability.