Provided is a ledger recognition system which can enhance recognition accuracy of a handwritten character filled out by a user thus capable of reducing a manual work in a correction operation. A ledger recognition system includes: a headquarter server configured to recognize handwritten characters described in a ledger by a user; a system terminal including an image scanner for reading the handwritten characters filled out in the ledger by the user; and a public telecommunication network which allows the headquarter server and the system terminal to be communicably connected with each other. The headquarter server includes a handwritten character recognition unit where the handwritten character recognition unit receives the image data of the ledger read by the image scanner from the system terminal, recognizes the handwritten characters written by the user in the image data of the received ledger in accordance with at least two types of OCR recognition programs having different algorithms, determines the handwritten characters described in the ledger with respect to a part of the handwritten characters where recognition results in accordance with the OCR recognition programs agree with each other, and sets a part of the handwritten characters where the recognition results by the OCR recognition programs do not agree with each other as an object of correction processing.