Embodiments of the invention are directed to a system and methods for determining a likelihood that an image that includes a user is a spoof or fake. In some embodiments, focus values are determined for various parts of the image during a focus sweep. The focus values may represent a focus point at which a particular part of the image is sharp. In some embodiments, the focus values may be determined only for the sections of the image that correspond to a face within the image. From the focus values, the system may determine a relative depth of various parts of the image. Using the relative depths, the system may generate a rough depth map for the image. The depth map may be analyzed to determine a likelihood that the image is authentic.