According to one embodiment of the present invention, a method for automatically generating metadata for a media document includes: computing a feature vector of the media document using a convolutional neural network; searching a collection of media documents for one or more matching media documents having corresponding feature vectors similar to the feature vector of the media document, each media document of the collection of media documents being associated with metadata; generating metadata for the media document based on the metadata associated with the one or more matching media documents; and displaying the media document in association with the generated metadata.