An approach is provided for performing sorting of physical mail items using Augmented Reality (A/R) glasses. A/R glasses acquire an image of a physical mail item to be sorted and generate image data that represents the image. A unique value is generated for the image, for example, by processing the image data for the image using one or more hash functions to generate a hash value. The hash value is used to obtain sorting information for the mail item from a mail item manager. The A/R glasses use the sorting information to assist the user in sorting the mail item by displaying the name of a sort location for the mail item, visually distinguishing the sort location from other sort locations, displaying information about the mail item, providing “out of view” assistance, etc. The A/R glasses may allow the user to override the sort location specified for the mail item and override information is sent to the mail item manager.