A removable riser hang-off connector is equipped with a flexible element that, in one embodiment, comprises rubber-encapsulated steel plates. The connector is designed for attachment to a hang-off collar provided on a steel catenary riser below the tapered stress joint or flex joint. Connection of the removable riser hang-off connector may be made by an ROV. With the removable riser hang-off connector attached, the tapered stress joint and/or flex joint may be raised out of the water (for inspection, maintenance, repair or replacement) by lifting the upper end of the SCR out of its porch receptacle with a chain jack (or other lifting device) and inserting the removable riser hang-off connector into the porch receptacle. This temporarily supports the SCR in an elevated state with the tapered stress joint and/or flex joint above the surface of the water.