A technique facilitates pressure containment with a retrievable cement bushing. The retrievable cement bushing comprises a body having an internal longitudinal passage. Additionally, the retrievable cement bushing comprises an engagement lug which cooperates with a sleeve. The engagement lug is mounted on the body and is movable to a radially outward position for engagement with a corresponding portion of a surrounding wall, e.g an internal packer wall. The sleeve is sized to receive a slick joint therethrough and is movable to a radially inward position relative to the engagement lug so as to hold the engagement lug in the radially outward position. The sleeve protects the slick joint from inwardly directed loading via the engagement lug when the retrievable cement bushing is subjected to differential pressures.