A damper speaker includes a fiber cloth woven by fibers, each of the fibers is formed by a single fiber strand or several fiber strands. The fiber strand includes a first fiber, which is one or a combination of cotton, polyester and aramid fiber. When the first fiber is the combination of cotton, polyester and aramid fiber, the weight ratio of any one to the fiber cloth is 0˜100%, and the weight ratio of the other two is adjusted. When the weight ratio of the first fiber to the fiber cloth is less than 100%, the fiber cloth includes a second fiber, which is one or a combination of rayon, silk, flax, acrylic, rubber and synthetic fiber. The speaker damper includes a layer of resin, which is absorbed by and combined with the fiber cloth. The fiber cloth is then cut into a predetermined shape through a molding means.