At least some aspects of the present disclosure feature systems and methods for managing notes. The note management system includes a note source, a note recognition module, a note extraction module, and a note labeling module. The note source is a visual representation of a scene having a note. The note recognition module is configured to receive the visual representation and determine a general boundary of the note from the visual representation. The note extraction module is configured to extract content of the note from the visual representation based on the determined general boundary. The note labeling module is configured to label the note with a category.