A method and apparatus for utilizing mammogram images for verification, including obtaining one or more mammogram image of a patient; determining a first set of breast characteristics from the one or more mammogram image, wherein the first set of breast characteristics include breast landmark, breast tissue density, tissue pattern and breast finding; comparing the first set of breast characteristics with a second set of breast characteristics to yield a comparison, wherein the second set of breast characteristics is from one or more previous mammogram image identified as potentially belonging to the patient using an identification not related to content of a mammogram image; and determining based on the comparison whether the one or more previous mammogram image belongs to the patient.