A tape dispenser includes a first arm, a second arm, a holder, a roller, a retaining device, a blade, spring(s) and one or more guides. The tape dispenser is positioned on a tape roll by positioning the holder on the inside of the tape roll and positioning the roller and retaining device on the outside of the tape roll. Tape is able to be pulled through the tape dispenser and then cut using the blade. After the tape is cut, the tape on the roll remains on the retaining device for easy access. The tape dispenser is also removable for use with many tape rolls.