A document handling history management system, which includes: a first calculation section that calculates a first value based on a document which is an object of referencing operation; an operation history information generation section that generates operation history information that includes the first value; a second calculation section that calculates a second value based on the operation history information; a referencing information generation section that generates referencing information of the document, the referencing information being used for the referencing operation and including the second value; a reading section that reads first attribute information of the document, the first attribute information being to be rewritten to second attribute information when the referencing operation of the document is performed; a storing section that stores setting information in the first attribute information; and a rewriting section that rewrites the second attribute information to the first attribute information upon termination of the referencing operation.