Information about media objects within media streams is inferred based on repeat instances of the media objects within the media streams. A system and methods enable the monitoring of one or more media streams and the identification of repeat instances of media objects (e.g., audio and/or video objects) within the media streams. The monitoring and object repeat identification is performed by one or more server computers on a network. Information about a media object can be inferred based on repeat instances of the media object and based on repeat instances of related media objects. The information is transferred from a server to a client in response to a user query entered at the client through an interactive user interface.