A biopsy cannula and a delivery catheter are configured to deliver one or more absorbable sponge pledgets to a biopsy site after removal of one or more tissue samples from the site. The delivery catheter allows a large amount of hydrated sponge material to be delivery to the biopsy site to facilitate hemostasis. One example of the delivery catheter includes a closed distal end, a side port, a tapered section, and an enlarged proximal portion for receiving the pledget. The side port of the delivery catheter is arranged to delivery the pledget through the side port of the biopsy cannula. In order to fill a relatively large biopsy site where multiple tissue samples have been taken in a radial pattern, the biopsy cannula is rotated and additional pledgets are delivered to the biopsy site at different radial locations. The absorbable sponge pledget may also be used as a marker for location of the biopsy site at a later time.