Methods and apparatus for populating a contact entry of a user based on information obtained from one or more sources that are external to the contact entry. Some implementations are directed generally to analyzing text of a document associated with the user to identify contact information in the document. In some versions of those implementations, an affinity measure associated with the document may be determined that is indicative of an amount of interest of the user in the document and a contact entry may be populated with one or more aspects of the contact information based on the affinity measure satisfying a threshold.