First retention member 40 and second retention member 42 are disposed so as to be separately arrayed along a direction orthogonal to a drawing direction, in which the first retention member 40 and the second retention member 42 are drawn from paper sheet storing unit. Upper opening of paper sheet storing bag 50 is sealed when the first retention member 40 moves toward and abuts on the second retention member 42. The first retention member 40 and the second retention member 42 is drawable to outside from the paper sheet storing unit only when the first retention member 40 and the second retention member 42 abut each other.