Systems and methods for facilitating contextual queries based on media samples automatically captured by a computing device are disclosed herein. A server receives from a computing device over a communication network, a media sample of a media asset automatically captured by the computing device. The server obtains contextual information corresponding to the captured media sample. The server stores the media sample in a memory indexed by the contextual information. The server receives, from the computing device over the communication network, a query that includes a criterion but lacks an identifier of the media asset. The server identifies the media sample in the memory by matching the query criterion to the contextual information. The server generates a reply to the query based on the identifying of the media sample and communicates the reply to the computing device over the communication network.