The de-identification system can be operable to receive, from at least one first entity, a medical scan and a corresponding medical report. A set of patient identifiers can be identified in a subset of fields of a header of the medical scan. A de-identified medical scan can be generated by replacing the subset of fields of the header of the medical scan with a corresponding set of anonymized fields generated by performing a header anonymization function. A subset of patient identifiers of the set of patient identifiers can be identified in the medical report. A de-identified medical report can be generated by replacing each of the subset of patient identifiers with corresponding anonymized placeholder text generated by performing a text anonymization function on the subset of patient identifiers. The de-identified medical scan and the de-identified medical report can be transmitted to a second entity via a network.