An image based email system associates images with different electronic mail (email) senders. The email system receives email messages from different email senders and then looks through either website member profiles or user contacts for associated images. Any located image is displayed in a list of recent senders. This allows the email user to associate recently received email messages with particular sender images or photographs. The images can also be used in a list of favorite or most frequent email senders. Other features of the email system extract information from received email messages to better identify the email senders. These and other features of the email system provide more intuitive and easier to perform email operations.