A pipe loosening device and methods are shown. In one example, the pipe loosening device enables a method wherein a pipe to be replaced is deformed but not burst, and a portion of a sidewall of the pipe is forced outward into the surrounding soil to compact a local region of the surrounding soil and loosen the existing pipe. The pipe may then pulled from the ground along an axis of the pipe.