An adaptive user authentication system is disclosed that executes user authentication by verifying user identity using different authentication steps based on a risk score. The risk score enables determining if the requesting user's identity is to be verified. If it is determined that the user identity is to be verified, a sequence of authentication steps is implemented wherein more and more data is collected regarding the user as the user fails to be authenticated at each of the authentication steps. A first authentication step includes a numerical-based authentication step followed by a second authentication step including a live image authentication. If the user fails to be authenticated at either the first or the second authentication steps then a third authentication step to verify the user's passport is implemented.