A paper sheet processing apparatus has a take-in device which takes in notes set in a setting unit, a judgment device which judges the quality and condition of a note taken in by the take-in device, a stacking box which stacks the note judged the quality and condition by the judgment device, a backup which is provided movably up and down in the stacking box and stacks notes, and a control device which variably controls the position of the backup based on the result of judgment by the judgment device.