In one embodiment, a method of manufacturing a semiconductor device includes forming first patterns on a workpiece layer, and forming second patterns containing a first metal on side faces of the first patterns. The method further includes removing the first patterns after forming the second patterns, and forming third patterns on side faces of the second patterns by a chemical change of the first metal after removing the first patterns. The method further includes removing the second patterns after forming the third patterns, and processing the workpiece layer by using the third patterns as a mask after removing the second patterns.