A semiconductor structure, a forming method thereof and a memory are provided. Wherein the semiconductor structure includes: a substrate; a bit line layer, located in the substrate; a word line stack layer, located on the substrate, wherein the word line stack layer includes a word line layer; and a gap, located between the bit line layer and the word line layer.