Embodiments are directed towards generating user isolated indexes for determining the content and relevance of relationships. User indexes may be generated that correspond to individual users of a larger population of users. Client applications may be accessed to determine items corresponding to the users. Information corresponding to the determined items may be listed in a user index corresponding to each user. Also, other information associated with the users may be stored in a data store separate from the user indexes. A context associated with one or more determined item may be determined based on an analysis of content included in the determined items, or other information. User indexes may be updated based on the determined contexts. Updating the user indexes may include updating the user index of the user associated with the determined items and updating other user indexes.