The present teaching relates to user authentication based on a visual representation of a location. In one example, a request is received for authenticating a user with respect to a user identity. A location of the user is determined. A candidate visual representation of the location is obtained from the user. One or more visual representations are retrieved from a database. The retrieved one or more visual representations are associated with the user identity in the database. Whether the user is authenticated is determined based on the candidate visual representation and the retrieved one or more visual representations.