Embodiments of the disclosure enable one or more financial transactions to be processed based on a transaction score generated based at least in part on a delivery receipt history. A financial transaction processing computing device receives a request for authorization for a present financial transaction associated with a cardholder account, identifies a reference delivery receipt corresponding to a prior financial transaction associated with the cardholder account, analyzes the reference delivery receipt to generate a confidence metric indicative of a confidence in a legitimacy of the prior financial transaction, and generates a transaction score for the present financial transaction that is indicative of an expected risk associated with approving the request for authorization. Aspects of the disclosure provide for authorizing one or more financial transactions based on an authentication of a recipient associated with a prior financial transaction.