Transcatheter heart valve delivery systems having a tip assembly configured to close the hole or perforation made in a patient's septal wall after transseptal delivery of a stented prosthetic heart valve to a defective heart valve (e.g., a mitral valve). The delivery device is configured to permit in vivo release of the tip assembly immediately after deployment of the stented prosthetic heart valve to implant the tip assembly into the septal wall proximate the hole through which the stented prosthetic heart valve is delivered. Methods of treating the defective heart valve, including closing the hole made during transseptal delivery of the stented prosthetic heart valve with the tip assembly of the delivery device are also disclosed.