A medical monitoring system extracts characteristic information for one or more medications from an image of the one or more medications on an uncontrolled background, the image being taken by a client device associated with a user of the medical monitoring system. The medical monitoring system determines prescription information associated with a medication, of the one or more medications, using the extracted characteristic information and a medication database, the medication database containing mappings between prescription information and characteristic information for a plurality of medications. The medical monitoring system provides a portion of the prescription information to the client device.