This disclosure describes various processes for collecting information about users from sources other than catalog activity data. This information can be used to generate recommendations for users with activity data deficiencies. Some example sources for this supplemental data include collaborative content sites, such as social networking sites. Social networking sites typically allow users to engage in conversations with other users through text, audio, and/or video. Conversation data collected from these sites or from other sources can be analyzed to infer user interests. A recommendation process (or other application) can use the inferred interests to supplement or take the place of catalog activity data.