According to one embodiment, a magnetic memory device includes a substrate, a first layer stack, and a second layer stack at a same side of the first layer stack relative to the substrate, and farther than the first layer stack from the substrate. Each of the first and second layer stack includes a reference layer, a tunnel barrier layer provided in a direction relative to the reference layer, the direction being perpendicular to the substrate, a storage layer provided in the direction relative to the tunnel barrier layer, and a first nonmagnetic layer provided in the direction relative to the storage layer. A heat absorption rate of the first nonmagnetic layer of the first layer stack is lower than a heat absorption rate of the first nonmagnetic layer of the second layer stack.