An apparatus for pulling a paper medium, e.g., a bill or a check in a bundle bill and check acceptor includes a transfer roller unit transferring the paper medium that is vertically introduced into a storage cassette, a transfer belt unit provided to be rotated so that the paper medium that has passed through the transfer roller unit is horizontally transferred to a rear of the storage cassette, and a clamping roller unit having first and second elastic clamps. Each of the clamps is configured to clamp and pull the front end of the paper medium, and release the paper medium at the rear of the storage cassette depending on rotation of the transfer belt unit, so that the paper medium is stacked in the storage cassette.