A label peeling unit having an installation body: a movable body movable while engaging with the installation body and stopping in a closed state or an open state in which the movable body is closed or open relative to the installation body; a label peeling body installed on the movable body and allowing backing paper of a continuous label body, which is conveyed by the paper sheet conveyance device, to be in contact with the label peeling body to bend the backing paper for peeling a part of a label off the backing paper; and a backing paper conveyance roller rotatably installed on the movable body and rotating while being in contact with a platen roller of the paper sheet conveyance device with the backing paper in between to thereby convey the backing paper and discharge it to the outside. The label peeling unit facilitates loading of paper sheets.